Jul 31 10:43:57 devstack cinder-volume[77869]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:43:57 devstack cinder-volume[77869]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:43:57 devstack cinder-volume[77869]: we strongly recommend against using it for new projects. Jul 31 10:43:57 devstack cinder-volume[77869]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:43:57 devstack cinder-volume[77869]: framework. For more detail see Jul 31 10:43:57 devstack cinder-volume[77869]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:43:57 devstack cinder-volume[77869]: import eventlet # noqa Jul 31 10:44:00 devstack cinder-volume[77869]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:44:00 devstack cinder-volume[77869]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:44:00 devstack cinder-volume[77869]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:44:01 devstack cinder-volume[77869]: INFO dbcounter [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Registered counter for database cinder Jul 31 10:44:01 devstack cinder-volume[77869]: DEBUG oslo_db.sqlalchemy.engines [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:01 devstack cinder-volume[77869]: DEBUG dbcounter [-] [77869] Writer thread running {{(pid=77869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:44:01 devstack cinder-volume[77869]: INFO cinder.rpc [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:44:01 devstack cinder-volume[77869]: INFO cinder.rpc [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:44:01 devstack cinder-volume[77869]: DEBUG oslo_db.sqlalchemy.engines [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:01 devstack cinder-volume[77869]: INFO cinder.volume.manager [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Determined volume DB was empty at startup. Jul 31 10:44:01 devstack cinder-volume[77869]: DEBUG cinder.volume.manager [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77869) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:44:01 devstack cinder-volume[77869]: INFO cinder.volume.manager [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 10:44:01 devstack cinder-volume[77869]: WARNING stevedore.named [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:44:01 devstack cinder-volume[77869]: WARNING castellan.key_manager [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:44:01 devstack cinder-volume[77869]: WARNING cinder.keymgr.conf_key_mgr [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:44:01 devstack cinder-volume[77869]: DEBUG cinder.volume.drivers.lvm [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77869) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 31 10:44:01 devstack cinder-volume[77869]: DEBUG oslo_concurrency.processutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_concurrency.processutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] CMD "cinder-rtstool verify" returned: 0 in 0.484s {{(pid=77869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_db.sqlalchemy.engines [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:02 devstack cinder-volume[77869]: INFO cinder.rpc [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 31 10:44:02 devstack cinder-volume[77869]: INFO cinder.rpc [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 31 10:44:02 devstack cinder-volume[77869]: WARNING stevedore.named [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:44:02 devstack cinder-volume[77869]: WARNING castellan.key_manager [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:44:02 devstack cinder-volume[77869]: INFO cinder.volume.manager [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_db.sqlalchemy.engines [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:02 devstack cinder-volume[77869]: INFO oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Starting 1 workers Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Started child 78070 {{(pid=77869) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Full set of CONF: {{(pid=77869) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] ******************************************************************************** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Configuration options gathered from: {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] ================================================================================ {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:44:02 devstack cinder-volume[78070]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] allow_availability_zone_fallback = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] allow_compression_on_image_upload = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] allowed_direct_url_schemes = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] api_rate_limit = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] auth_strategy = keystone {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] az_cache_duration = 3600 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_availability_zone = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_host = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_stats_polling_interval = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backup_api_class = cinder.backup.api.API {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backup_name_template = backup-%s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backup_use_same_host = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backup_use_temp_snapshot = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] chap_password = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] chap_username = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_internal_tenant_project_id = ccad07be3d9241d8a0f2de617591d83e {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_internal_tenant_user_id = 378e2136e80d4ad782d74038d31110f3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cloned_volume_same_az = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cluster = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] compression_format = gzip {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] compute_api_class = cinder.compute.nova.API {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] config_dir = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] config_source = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] control_exchange = openstack {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] debug = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] default_availability_zone = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] default_group_type = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] default_volume_type = lvmdriver-1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] disk_geometry = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] driver_client_cert = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] driver_client_cert_key = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] driver_data_namespace = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] driver_ssl_cert_path = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] driver_ssl_cert_verify = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] driver_use_ssl = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] enable_force_upload = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] enable_new_services = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] enable_unsupported_driver = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] enforce_multipath_for_image_xfer = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] filter_function = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_api_insecure = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_api_servers = ['http://192.168.122.88/image'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_api_ssl_compression = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_ca_certificates_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_catalog_info = image:glance:publicURL {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_num_retries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance_request_timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] goodness_function = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] graceful_shutdown_timeout = 5 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] group_api_class = cinder.group.api.API {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] host = devstack {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_compress_on_upload = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_conversion_address_space_limit = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_conversion_cpu_limit = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_conversion_disable = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_upload_use_cinder_backend = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_upload_use_internal_tenant = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_volume_cache_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_volume_cache_max_count = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] image_volume_cache_max_size_gb = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] init_host_max_objects_retrieval = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] instance_format = [instance: %(uuid)s] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[78070]: INFO cinder.volume.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] iscsi_target_flags = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] iscsi_write_cache = on {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] iser_helper = tgtadm {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] iser_ip_address = 192.168.122.88 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] iser_port = 3260 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_color = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_config_append = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_dir = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_options = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_rotate_interval = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_rotate_interval_type = days {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] log_rotation_type = none {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] max_age = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] max_logfile_count = 30 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] max_logfile_size_mb = 200 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] max_over_subscription_ratio = 20.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] message_reap_interval = 86400 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] message_ttl = 2592000 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] migration_create_volume_timeout_secs = 300 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] monkey_patch = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] monkey_patch_modules = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] my_ip = 192.168.122.88 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] no_snapshot_gb_quota = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] num_iser_scan_tries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] num_shell_tries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] num_volume_device_scan_tries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] nvmeof_conn_info_version = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] nvmet_ns_id = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] nvmet_port_id = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_max_limit = 1000 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_volume_ext_list = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_volume_listen_port = 8776 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_volume_use_ssl = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] osapi_volume_workers = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] per_volume_size_limit = -1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] periodic_fuzzy_delay = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] periodic_interval = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] public_endpoint = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] publish_errors = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_backup_gigabytes = 1000 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_backups = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_gigabytes = 1000 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_groups = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_snapshots = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] quota_volumes = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] rate_limit_burst = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] rate_limit_except_level = CRITICAL {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] rate_limit_interval = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] reinit_driver_count = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] replication_device = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] report_discard_supported = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] report_interval = 120 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] reservation_clean_interval = 86400 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] reservation_expire = 86400 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] reserved_image_namespaces = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] reserved_percentage = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] rpc_response_timeout = 120 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] run_external_periodic_tasks = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] scst_target_driver = iscsi {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] scst_target_iqn_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_down_time = 720 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] shell_completion = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] snapshot_name_template = snapshot-%s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] snapshot_same_host = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] split_loggers = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] state_path = /opt/stack/data/cinder {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] storage_availability_zone = nova {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] storage_protocol = iSCSI {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] syslog_log_facility = LOG_USER {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] target_helper = lioadm {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] target_ip_address = 192.168.122.88 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] target_port = 3260 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] target_protocol = iscsi {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] target_secondary_ip_addresses = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] trace_flags = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] transport_url = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] until_refresh = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_chap_auth = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_default_quota_class = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_journal = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_json = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_multipath_for_image_xfer = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_stderr = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] use_syslog = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] verify_glance_signatures = enabled {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_api_class = cinder.volume.api.API {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_backend_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_clear = zero {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_clear_ionice = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_clear_size = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_copy_bps_limit = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_dd_blocksize = 1M {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_name_template = volume-%s {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_service_inithost_offload = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volume_usage_audit_period = month {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] zoning_mode = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_concurrency.disable_process_locking = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.auth_section = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.auth_type = password {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.auth_version = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.cache = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.include_service_catalog = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.insecure = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.interface = public {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_password = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcache_username = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.region_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.service_type = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.88/identity {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.backend = dogpile.cache.null {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.backend_argument = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.backend_expiration_time = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.config_prefix = cache.oslo {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.debug_cache_backend = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.enable_retry_client = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.enable_socket_keepalive = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.expiration_time = 600 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.hashclient_retry_attempts = 2 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_dead_retry = 300 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_pool_maxsize = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_sasl_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.password = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.proxies = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.redis_db = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.redis_server = localhost:6379 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.retry_attempts = 2 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.retry_delay = 0.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.socket_keepalive_count = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.socket_keepalive_idle = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.socket_keepalive_interval = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.socket_timeout = 1.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.tls_allowed_ciphers = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.tls_cafile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.tls_certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.tls_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.tls_keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cache.username = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] coordination.backend_url = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.asyncio_connection = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.asyncio_slave_connection = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.backend = sqlalchemy {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.connection = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.connection_debug = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.connection_parameters = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.connection_recycle_time = 3600 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.connection_trace = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.db_inc_retry_interval = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.db_max_retries = 20 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.db_max_retry_interval = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.db_retry_interval = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.max_overflow = 50 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.max_pool_size = 5 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.max_retries = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.mysql_wsrep_sync_wait = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.pool_timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.retry_interval = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.slave_connection = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.sqlite_synchronous = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.synchronous_reader = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] database.use_db_reconnect = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.connection_string = messaging:// {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.es_doc_type = notification {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.es_scroll_size = 10000 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.es_scroll_time = 2m {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.filter_error_trace = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.hmac_keys = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.sentinel_service_name = mymaster {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.socket_timeout = 0.1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.trace_requests = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler.trace_sqlalchemy = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler_jaeger.process_tags = {} {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler_jaeger.service_name_prefix = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] profiler_otlp.service_name_prefix = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.enforce_new_defaults = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.policy_default_rule = default {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.policy_file = policy.yaml {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.group = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.helper_command = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack sudo[78152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] privsep_osbrick.user = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.group = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.helper_command = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack sudo[78152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] cinder_sys_admin.user = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.auth_section = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.auth_type = password {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.cafile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.collect_timing = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.insecure = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.send_service_user_token = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.split_loggers = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] service_user.timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.auth_section = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.auth_type = password {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.collect_timing = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.insecure = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.region_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.split_loggers = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] glance.timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.backend_availability_zone = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.chap_password = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.chap_username = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.disk_geometry = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.driver_client_cert = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.driver_client_cert_key = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.driver_data_namespace = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.driver_use_ssl = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.extra_capabilities = {} {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.filter_function = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.goodness_function = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.iscsi_target_flags = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.iscsi_write_cache = on {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.iser_helper = tgtadm {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.iser_ip_address = 192.168.122.88 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.iser_port = 3260 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.lvm_share_target = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.lvm_type = auto {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.num_shell_tries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.replication_device = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.report_discard_supported = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.reserved_percentage = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.target_helper = tgtadm {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.target_ip_address = 192.168.122.88 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.target_port = 3260 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.target_protocol = iscsi {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.trace_flags = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.unique_fqdn_network = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.use_chap_auth = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_backend_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_clear = zero {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_clear_ionice = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_clear_size = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_reports.file_event_handler = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_reports.log_dir = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.backend_host = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.chap_password = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.chap_username = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.disk_geometry = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.driver_client_cert = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.extra_capabilities = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.filter_function = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.goodness_function = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.iser_helper = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.iser_ip_address = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.iser_port = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.lvm_share_target = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.lvm_type = auto {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.num_shell_tries = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.replication_device = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.report_discard_supported = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.reserved_percentage = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.scst_target_driver = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.storage_protocol = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.target_helper = lioadm {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.target_ip_address = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.target_port = 3260 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.trace_flags = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.use_chap_auth = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_clear = zero {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_clear_size = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] lvmdriver-1.volumes_dir = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_notifications.driver = [] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_notifications.retry = -1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] key_manager.fixed_key = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.barbican_api_version = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.barbican_endpoint = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.barbican_endpoint_type = public {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.barbican_region_name = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.cafile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.collect_timing = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.insecure = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.number_of_retries = 60 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.retry_delay = 1 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.send_service_user_token = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.split_loggers = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.verify_ssl = True {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican.verify_ssl_path = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.auth_section = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.auth_type = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.cafile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.certfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.collect_timing = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.insecure = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.keyfile = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.split_loggers = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] barbican_service_user.timeout = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.approle_role_id = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.approle_secret_id = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.auth_method = approle {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.auth_path = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.kv_mountpoint = secret {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.kv_path = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.kv_version = 2 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.namespace = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.root_token_id = **** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.ssl_ca_crt_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.timeout = 60.0 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.token_file = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.token_role = None {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.use_ssl = False {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:44:02 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] ******************************************************************************** {{(pid=77869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:44:03 devstack sudo[78152]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:03 devstack sudo[78249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:03 devstack sudo[78249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:03 devstack sudo[78249]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.321s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:44:03 devstack cinder-volume[78070]: INFO cinder.brick.local_dev.lvm [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:03 devstack sudo[78360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:03 devstack sudo[78360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:03 devstack sudo[78360]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG cinder.brick.local_dev.lvm [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78070) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 31 10:44:03 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:03 devstack sudo[78452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:03 devstack sudo[78452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:05 devstack sudo[78452]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.560s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:05 devstack sudo[78755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:05 devstack sudo[78755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:05 devstack sudo[78755]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:05 devstack sudo[78804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 31 10:44:05 devstack sudo[78804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:05 devstack sudo[78804]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.258s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:05 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:05 devstack sudo[78807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:05 devstack sudo[78807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:06 devstack sudo[78807]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:06 devstack sudo[78810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:06 devstack sudo[78810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:06 devstack sudo[78810]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:06 devstack sudo[78813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:06 devstack sudo[78813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:06 devstack sudo[78813]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:06 devstack sudo[78822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:06 devstack sudo[78822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:06 devstack sudo[78822]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:06 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack sudo[78826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:07 devstack sudo[78826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:07 devstack sudo[78826]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:07 devstack cinder-volume[78070]: INFO cinder.volume.drivers.lvm [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack sudo[78830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:07 devstack sudo[78830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:07 devstack sudo[78830]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG cinder.volume.drivers.lvm [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Updating volume stats {{(pid=78070) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack sudo[78833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:07 devstack sudo[78833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:07 devstack sudo[78833]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:07 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:07 devstack sudo[78838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:07 devstack sudo[78838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:08 devstack sudo[78838]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack sudo[78841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:08 devstack sudo[78841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:08 devstack sudo[78841]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack sudo[78845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:08 devstack sudo[78845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:08 devstack sudo[78845]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:08 devstack cinder-volume[78070]: INFO cinder.volume.driver [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG cinder.volume.driver [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78070) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_db.sqlalchemy.engines [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG dbcounter [-] [78070] Writer thread running {{(pid=78070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG cinder.db.api [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Building query based on filter {{(pid=78070) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG cinder.image.image_utils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78070) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:44:08 devstack cinder-volume[78070]: INFO cinder.keymgr.migration [None req-09e1ffc0-418a-4333-b778-4ecd44d97b15 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG cinder.volume.drivers.lvm [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Updating volume stats {{(pid=78070) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:44:08 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:08 devstack sudo[78850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:08 devstack sudo[78850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[78850]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:09 devstack sudo[78853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:09 devstack sudo[78853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[78853]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:09 devstack sudo[78856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:09 devstack sudo[78856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[78856]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:09 devstack sudo[78859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:09 devstack sudo[78859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:09 devstack sudo[78859]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:09 devstack cinder-volume[78070]: DEBUG cinder.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Notifying Schedulers of capabilities ... {{(pid=78070) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:44:09 devstack cinder-volume[78070]: INFO cinder.volume.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Driver initialization completed successfully. Jul 31 10:44:09 devstack cinder-volume[78070]: INFO cinder.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Initiating service 2 cleanup Jul 31 10:44:10 devstack cinder-volume[78070]: INFO cinder.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Service 2 cleanup completed. Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG cinder.service [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Creating RPC server for service cinder-volume {{(pid=78070) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG cinder.service [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78070) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:44:10 devstack cinder-volume[78070]: INFO cinder.volume.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG cinder.volume.drivers.lvm [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Updating volume stats {{(pid=78070) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack sudo[78873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:44:10 devstack sudo[78873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:10 devstack sudo[78873]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack sudo[78879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:10 devstack sudo[78879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:10 devstack sudo[78879]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:10 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:10 devstack sudo[78894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:44:10 devstack sudo[78894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:11 devstack sudo[78894]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:11 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:11 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:44:11 devstack sudo[78997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:44:11 devstack sudo[78997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:44:11 devstack sudo[78997]: pam_unix(sudo:session): session closed for user root Jul 31 10:44:11 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:44:11 devstack cinder-volume[78070]: INFO cinder.volume.manager [None req-4dd847ea-dfaf-4f18-bc9d-2ed920dab0f0 None None] Driver post RPC initialization completed successfully. Jul 31 10:44:12 devstack cinder-volume[77869]: DEBUG dbcounter [-] [77869] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:21 devstack cinder-volume[78070]: DEBUG dbcounter [-] [78070] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:21 devstack cinder-volume[78070]: DEBUG dbcounter [-] [78070] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=78070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:44:57 devstack cinder-volume[78070]: DEBUG oslo_service.periodic_task [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running periodic task VolumeManager._thread_info {{(pid=78070) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:44:57 devstack cinder-volume[78070]: DEBUG cinder.volume.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] thread count: 6 {{(pid=78070) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:44:57 devstack cinder-volume[78070]: DEBUG cinder.volume.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] thread info: [<_MainThread(MainThread, started 139141498101888)>, , , , , ] {{(pid=78070) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG oslo_service.periodic_task [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78070) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG cinder.volume.drivers.lvm [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Updating volume stats {{(pid=78070) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:57 devstack sudo[84105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:45:57 devstack sudo[84105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:57 devstack sudo[84105]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:57 devstack sudo[84108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:45:57 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:57 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:57 devstack sudo[84111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:45:57 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:58 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:45:58 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:45:58 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:45:58 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG cinder.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Notifying Schedulers of capabilities ... {{(pid=78070) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG oslo_service.periodic_task [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running periodic task VolumeManager._thread_info {{(pid=78070) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG cinder.volume.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] thread count: 6 {{(pid=78070) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:45:58 devstack cinder-volume[78070]: DEBUG cinder.volume.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] thread info: [<_MainThread(MainThread, started 139141498101888)>, , , , , ] {{(pid=78070) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:46:21 devstack cinder-volume[78070]: DEBUG dbcounter [-] [78070] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=78070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG oslo_service.periodic_task [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78070) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG cinder.volume.drivers.lvm [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Updating volume stats {{(pid=78070) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:57 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:46:57 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:57 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:57 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:46:57 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:57 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:57 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:46:57 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:58 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:46:58 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:46:58 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:46:58 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Jul 31 10:46:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:46:58 devstack cinder-volume[78070]: DEBUG cinder.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Notifying Schedulers of capabilities ... {{(pid=78070) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG oslo_service.periodic_task [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78070) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG cinder.volume.drivers.lvm [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Updating volume stats {{(pid=78070) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:57 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 31 10:47:57 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:57 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:57 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:47:57 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:57 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:57 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:57 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 31 10:47:57 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:58 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:47:58 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 31 10:47:58 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:47:58 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG oslo_concurrency.processutils [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=78070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG cinder.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Notifying Schedulers of capabilities ... {{(pid=78070) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG oslo_service.periodic_task [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] Running periodic task VolumeManager._thread_info {{(pid=78070) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG cinder.volume.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] thread count: 6 {{(pid=78070) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:47:58 devstack cinder-volume[78070]: DEBUG cinder.volume.manager [None req-cbc15cf9-1f13-4cf7-a67f-22a135178c03 None None] thread info: [<_MainThread(MainThread, started 139141498101888)>, , , , , ] {{(pid=78070) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:48:21 devstack cinder-volume[78070]: DEBUG dbcounter [-] [78070] Writing DB stats cinder:SELECT=1 {{(pid=78070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:21 devstack cinder-volume[78070]: DEBUG dbcounter [-] [78070] Writing DB stats cinder:UPDATE=1 {{(pid=78070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:48:40 devstack cinder-volume[77869]: INFO oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Caught SIGTERM, stopping children Jul 31 10:48:40 devstack cinder-volume[77869]: DEBUG oslo_concurrency.lockutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Acquiring lock "singleton_lock" {{(pid=77869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:40 devstack cinder-volume[77869]: DEBUG oslo_concurrency.lockutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Acquired lock "singleton_lock" {{(pid=77869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:40 devstack cinder-volume[77869]: DEBUG oslo_concurrency.lockutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Releasing lock "singleton_lock" {{(pid=77869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:40 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Stop services. {{(pid=77869) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 10:48:40 devstack cinder-volume[77869]: DEBUG oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Killing children. {{(pid=77869) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 10:48:40 devstack cinder-volume[77869]: INFO oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Waiting on 1 children to exit Jul 31 10:48:45 devstack cinder-volume[78070]: DEBUG oslo_concurrency.lockutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Acquiring lock "singleton_lock" {{(pid=78070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:45 devstack cinder-volume[78070]: DEBUG oslo_concurrency.lockutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Acquired lock "singleton_lock" {{(pid=78070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:45 devstack cinder-volume[78070]: DEBUG oslo_concurrency.lockutils [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Releasing lock "singleton_lock" {{(pid=78070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:45 devstack cinder-volume[78070]: WARNING amqp [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:48:45 devstack cinder-volume[78070]: WARNING amqp [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:48:45 devstack cinder-volume[77869]: INFO oslo_service.backend._eventlet.service [None req-d5da6a48-5d2a-4e73-829e-59efb7f00582 None None] Child 78070 exited with status 0 Jul 31 10:48:45 devstack cinder-volume[88124]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:48:45 devstack cinder-volume[88124]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:48:45 devstack cinder-volume[88124]: we strongly recommend against using it for new projects. Jul 31 10:48:45 devstack cinder-volume[88124]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:48:45 devstack cinder-volume[88124]: framework. For more detail see Jul 31 10:48:45 devstack cinder-volume[88124]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:48:45 devstack cinder-volume[88124]: import eventlet # noqa Jul 31 10:48:47 devstack cinder-volume[88124]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:47 devstack cinder-volume[88124]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:47 devstack cinder-volume[88124]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:48 devstack cinder-volume[88124]: INFO dbcounter [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Registered counter for database cinder Jul 31 10:48:48 devstack cinder-volume[88124]: DEBUG oslo_db.sqlalchemy.engines [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:48 devstack cinder-volume[88124]: DEBUG dbcounter [-] [88124] Writer thread running {{(pid=88124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:48:48 devstack cinder-volume[88124]: INFO cinder.rpc [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:48:49 devstack cinder-volume[88124]: INFO cinder.rpc [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_db.sqlalchemy.engines [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:49 devstack cinder-volume[88124]: INFO cinder.volume.manager [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Determined volume DB was empty at startup. Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG cinder.volume.manager [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88124) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:48:49 devstack cinder-volume[88124]: INFO cinder.volume.manager [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 31 10:48:49 devstack cinder-volume[88124]: WARNING stevedore.named [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:48:49 devstack cinder-volume[88124]: WARNING castellan.key_manager [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:48:49 devstack cinder-volume[88124]: WARNING cinder.keymgr.conf_key_mgr [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:48:49 devstack cinder-volume[88124]: INFO cinder.volume.manager [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_db.sqlalchemy.engines [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:49 devstack cinder-volume[88124]: INFO oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Starting 1 workers Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Started child 88351 {{(pid=88124) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Full set of CONF: {{(pid=88124) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] ******************************************************************************** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Configuration options gathered from: {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] ================================================================================ {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] allow_availability_zone_fallback = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] allow_compression_on_image_upload = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] allowed_direct_url_schemes = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] api_rate_limit = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] auth_strategy = keystone {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_availability_zone = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_host = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88351]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_stats_polling_interval = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backup_api_class = cinder.backup.api.API {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backup_name_template = backup-%s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backup_use_same_host = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backup_use_temp_snapshot = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] chap_password = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] chap_username = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_internal_tenant_project_id = ccad07be3d9241d8a0f2de617591d83e {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_internal_tenant_user_id = 378e2136e80d4ad782d74038d31110f3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cluster = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] compression_format = gzip {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] compute_api_class = cinder.compute.nova.API {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] config_dir = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] config_source = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] control_exchange = openstack {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] debug = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] default_availability_zone = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] default_group_type = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] default_volume_type = QuobyteHD {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] disk_geometry = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] driver_client_cert = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] driver_client_cert_key = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] driver_data_namespace = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] driver_ssl_cert_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] driver_ssl_cert_verify = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] driver_use_ssl = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] enable_new_services = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] enable_unsupported_driver = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] enabled_backends = ['QuobyteHD'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] enforce_multipath_for_image_xfer = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] filter_function = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_api_insecure = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_api_servers = ['http://192.168.122.88/image'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_api_ssl_compression = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_ca_certificates_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_catalog_info = image:glance:publicURL {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_num_retries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance_request_timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] goodness_function = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] graceful_shutdown_timeout = 5 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] group_api_class = cinder.group.api.API {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] host = devstack {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_compress_on_upload = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_conversion_address_space_limit = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_conversion_cpu_limit = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_conversion_disable = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_upload_use_cinder_backend = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_upload_use_internal_tenant = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_volume_cache_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_volume_cache_max_count = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] image_volume_cache_max_size_gb = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] init_host_max_objects_retrieval = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] instance_format = [instance: %(uuid)s] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] iscsi_target_flags = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] iscsi_write_cache = on {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] iser_helper = tgtadm {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] iser_ip_address = 192.168.122.88 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] iser_port = 3260 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_color = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_config_append = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_dir = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_options = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_rotate_interval = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_rotate_interval_type = days {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] log_rotation_type = none {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88351]: INFO cinder.volume.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.remotefs [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88351) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] max_age = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] max_logfile_count = 30 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] max_logfile_size_mb = 200 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] max_over_subscription_ratio = 20.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] message_reap_interval = 86400 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] message_ttl = 2592000 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] migration_create_volume_timeout_secs = 300 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] monkey_patch = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] monkey_patch_modules = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] my_ip = 192.168.122.88 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] no_snapshot_gb_quota = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] num_iser_scan_tries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] num_shell_tries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] num_volume_device_scan_tries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] nvmeof_conn_info_version = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] nvmet_ns_id = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] nvmet_port_id = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_max_limit = 1000 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_volume_ext_list = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_volume_listen = 0.0.0.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_volume_listen_port = 8776 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_volume_use_ssl = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] osapi_volume_workers = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] per_volume_size_limit = -1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] periodic_fuzzy_delay = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] periodic_interval = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] project_id_regex = [0-9a-f\-]+ {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] public_endpoint = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] publish_errors = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_backup_gigabytes = 1000 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_backups = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_gigabytes = 1000 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_groups = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_snapshots = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] quota_volumes = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] rate_limit_burst = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] rate_limit_except_level = CRITICAL {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] rate_limit_interval = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] reinit_driver_count = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] replication_device = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] report_discard_supported = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] report_interval = 120 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] reservation_clean_interval = 86400 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] reservation_expire = 86400 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] reserved_image_namespaces = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] reserved_percentage = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] rpc_response_timeout = 120 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] run_external_periodic_tasks = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] scst_target_driver = iscsi {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] scst_target_iqn_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_down_time = 720 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] shell_completion = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] snapshot_name_template = snapshot-%s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] split_loggers = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] state_path = /opt/stack/data/cinder {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] storage_availability_zone = nova {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] storage_protocol = iSCSI {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] syslog_log_facility = LOG_USER {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] target_helper = lioadm {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] target_ip_address = 192.168.122.88 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] target_port = 3260 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] target_protocol = iscsi {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] target_secondary_ip_addresses = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] trace_flags = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] transfer_api_class = cinder.transfer.api.API {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] transport_url = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] until_refresh = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_chap_auth = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_default_quota_class = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_journal = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_json = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_multipath_for_image_xfer = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_stderr = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] use_syslog = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] verify_glance_signatures = enabled {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_api_class = cinder.volume.api.API {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_backend_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_clear = zero {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_clear_ionice = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_clear_size = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_copy_bps_limit = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_dd_blocksize = 1M {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_name_template = volume-%s {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_service_inithost_offload = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volume_usage_audit_period = month {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] zoning_mode = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_concurrency.disable_process_locking = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.auth_section = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.auth_type = password {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.auth_version = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.cache = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.delay_auth_decision = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.http_connect_timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.include_service_catalog = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.insecure = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88351) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 31 10:48:49 devstack cinder-volume[88351]: WARNING cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 10:48:49 devstack cinder-volume[88351]: WARNING cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.interface = public {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_password = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Running cmd (subprocess): mount.quobyte {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcache_username = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.region_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.service_token_roles_required = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.service_type = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.token_cache_time = 300 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.88/identity {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.backend = dogpile.cache.null {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.backend_argument = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.backend_expiration_time = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.config_prefix = cache.oslo {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.debug_cache_backend = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.enable_retry_client = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.enable_socket_keepalive = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.expiration_time = 600 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.hashclient_retry_attempts = 2 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_dead_retry = 300 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_pool_maxsize = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_sasl_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.password = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.proxies = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.redis_db = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.redis_sentinel_service_name = mymaster {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.redis_server = localhost:6379 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.retry_attempts = 2 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.retry_delay = 0.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.socket_keepalive_count = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.socket_keepalive_idle = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.socket_keepalive_interval = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.socket_timeout = 1.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.tls_allowed_ciphers = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.tls_cafile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.tls_certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.tls_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.tls_keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cache.username = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] coordination.backend_url = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.asyncio_connection = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.asyncio_slave_connection = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.backend = sqlalchemy {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.connection = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.connection_debug = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.connection_parameters = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.connection_recycle_time = 3600 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.connection_trace = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.db_inc_retry_interval = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.db_max_retries = 20 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.db_max_retry_interval = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.db_retry_interval = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.max_overflow = 50 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.max_pool_size = 5 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.max_retries = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.mysql_wsrep_sync_wait = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.pool_timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.retry_interval = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.slave_connection = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.sqlite_synchronous = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.synchronous_reader = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] database.use_db_reconnect = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.connection_string = messaging:// {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.es_doc_type = notification {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.es_scroll_size = 10000 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.es_scroll_time = 2m {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.filter_error_trace = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.hmac_keys = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.sentinel_service_name = mymaster {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.socket_timeout = 0.1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.trace_requests = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler.trace_sqlalchemy = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler_jaeger.process_tags = {} {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler_jaeger.service_name_prefix = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] profiler_otlp.service_name_prefix = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.enforce_new_defaults = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.policy_default_rule = default {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.policy_file = policy.yaml {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_policy.remote_timeout = 60.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.group = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.helper_command = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] privsep_osbrick.user = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.group = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.helper_command = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack quobyte-client[88364]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] cinder_sys_admin.user = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.auth_section = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.auth_type = password {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.cafile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.collect_timing = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack quobyte-client[88364]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.insecure = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.send_service_user_token = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.split_loggers = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] service_user.timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.auth_section = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] CMD "mount.quobyte" returned: 1 in 0.104s {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.auth_type = password {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.collect_timing = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.insecure = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88351) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.region_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.split_loggers = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] glance.timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.backend_availability_zone = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: INFO cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 ... Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.chap_password = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.chap_username = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.disk_geometry = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.driver_client_cert = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 -c /etc/quobyte/client-cinder.cfg {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.driver_client_cert_key = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.driver_data_namespace = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.driver_use_ssl = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.enable_unsupported_driver = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.extra_capabilities = {} {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.filter_function = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.goodness_function = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.iscsi_target_flags = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.iscsi_write_cache = on {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.iser_helper = tgtadm {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.iser_ip_address = 192.168.122.88 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.iser_port = 3260 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_host = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_login = admin {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_mount_options = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_password = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_private_key = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_share_path = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_ssh_port = 22 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.num_shell_tries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.nvmet_port_id = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_client_cfg = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.quobyte_volume_url = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.replication_device = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.report_discard_supported = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.reserved_percentage = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.scst_target_driver = iscsi {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.scst_target_iqn_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.storage_protocol = iSCSI {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.target_helper = tgtadm {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.target_ip_address = 192.168.122.88 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.target_port = 3260 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.target_protocol = iscsi {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.trace_flags = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.unique_fqdn_network = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.use_chap_auth = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_backend_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_clear = zero {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_clear_ionice = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_clear_size = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_reports.file_event_handler = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_reports.log_dir = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.backend_availability_zone = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.backend_host = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.chap_password = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.chap_username = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.chiscsi_conf = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.disk_geometry = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.driver_client_cert = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.driver_client_cert_key = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.driver_data_namespace = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.driver_use_ssl = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 -c /etc/quobyte/client-cinder.cfg Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.extra_capabilities = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.filter_function = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.goodness_function = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.iscsi_target_flags = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.iscsi_write_cache = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.iser_helper = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.iser_ip_address = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.iser_port = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.iser_target_prefix = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_host = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_login = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_mount_options = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_password = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_private_key = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_share_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_ssh_port = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.num_shell_tries = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nvmet_ns_id = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.nvmet_port_id = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.replication_device = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.report_discard_supported = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.reserved_percentage = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.scst_target_driver = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.storage_protocol = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.target_helper = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.target_ip_address = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.target_port = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.target_prefix = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.target_protocol = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.trace_flags = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.unique_fqdn_network = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.use_chap_auth = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_clear = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_clear_ionice = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_clear_size = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] QuobyteHD.volumes_dir = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.ssl_version = {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_notifications.driver = [] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_notifications.retry = -1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] oslo_messaging_notifications.transport_url = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] key_manager.fixed_key = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.barbican_api_version = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.barbican_endpoint = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.barbican_endpoint_type = public {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.barbican_region_name = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.cafile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.collect_timing = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.insecure = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.number_of_retries = 60 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.retry_delay = 1 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.send_service_user_token = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.split_loggers = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.verify_ssl = True {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican.verify_ssl_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.auth_section = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.auth_type = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.cafile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.certfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.collect_timing = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.insecure = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.keyfile = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.split_loggers = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] barbican_service_user.timeout = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.approle_role_id = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.approle_secret_id = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.auth_method = approle {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.auth_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.kv_mountpoint = secret {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.kv_path = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.kv_version = 2 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.namespace = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.root_token_id = **** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.ssl_ca_crt_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.timeout = 60.0 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.token_file = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.token_role = None {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.use_ssl = False {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:49 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] ******************************************************************************** {{(pid=88124) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:48:50 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.528s {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:50 devstack cinder-volume[88351]: INFO cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 succeeded Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88351) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.554s {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:50 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:48:50 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:50 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.293s {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:50 devstack cinder-volume[88351]: INFO cinder.volume.driver [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG cinder.volume.driver [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5441589355469, 'free_capacity_gb': 1775.5441589355469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88351) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_db.sqlalchemy.engines [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88351) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG dbcounter [-] [88351] Writer thread running {{(pid=88351) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG cinder.db.api [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Building query based on filter {{(pid=88351) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG cinder.image.image_utils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88351) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:48:50 devstack cinder-volume[88351]: INFO cinder.keymgr.migration [None req-342d89c3-3672-4d54-b14d-b5f9a1f8bb77 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88351) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88351) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:50 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:50 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:48:50 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:51 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.364s {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG cinder.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Notifying Schedulers of capabilities ... {{(pid=88351) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:48:51 devstack cinder-volume[88351]: INFO cinder.volume.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Driver initialization completed successfully. Jul 31 10:48:51 devstack cinder-volume[88351]: INFO cinder.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Initiating service 3 cleanup Jul 31 10:48:51 devstack cinder-volume[88351]: INFO cinder.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Service 3 cleanup completed. Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG cinder.service [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Creating RPC server for service cinder-volume {{(pid=88351) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG cinder.service [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88351) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:48:51 devstack cinder-volume[88351]: INFO cinder.volume.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88351) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG cinder.volume.drivers.quobyte [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88351) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88351) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:51 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:51 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:48:51 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:52 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:52 devstack cinder-volume[88351]: DEBUG oslo_concurrency.processutils [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.671s {{(pid=88351) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:52 devstack cinder-volume[88351]: INFO cinder.volume.manager [None req-a013ee2b-1a83-405f-b0da-9abe17b51ac2 None None] Driver post RPC initialization completed successfully. Jul 31 10:48:54 devstack cinder-volume[88124]: INFO oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Caught SIGTERM, stopping children Jul 31 10:48:54 devstack cinder-volume[88124]: DEBUG oslo_concurrency.lockutils [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Acquiring lock "singleton_lock" {{(pid=88124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:54 devstack cinder-volume[88124]: DEBUG oslo_concurrency.lockutils [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Acquired lock "singleton_lock" {{(pid=88124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:54 devstack cinder-volume[88124]: DEBUG oslo_concurrency.lockutils [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Releasing lock "singleton_lock" {{(pid=88124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:54 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Stop services. {{(pid=88124) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 31 10:48:54 devstack cinder-volume[88124]: DEBUG oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Killing children. {{(pid=88124) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 31 10:48:54 devstack cinder-volume[88124]: INFO oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Waiting on 1 children to exit Jul 31 10:48:55 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Acquiring lock "singleton_lock" {{(pid=88351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:55 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Acquired lock "singleton_lock" {{(pid=88351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:55 devstack cinder-volume[88351]: DEBUG oslo_concurrency.lockutils [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Releasing lock "singleton_lock" {{(pid=88351) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:55 devstack cinder-volume[88351]: WARNING amqp [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:48:55 devstack cinder-volume[88351]: WARNING amqp [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 31 10:48:55 devstack cinder-volume[88124]: INFO oslo_service.backend._eventlet.service [None req-9b47631f-0c97-4055-ad6e-c1252eb3440c None None] Child 88351 exited with status 0 Jul 31 10:48:55 devstack cinder-volume[88746]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 31 10:48:55 devstack cinder-volume[88746]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:48:55 devstack cinder-volume[88746]: we strongly recommend against using it for new projects. Jul 31 10:48:55 devstack cinder-volume[88746]: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:48:55 devstack cinder-volume[88746]: framework. For more detail see Jul 31 10:48:55 devstack cinder-volume[88746]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:48:55 devstack cinder-volume[88746]: import eventlet # noqa Jul 31 10:48:58 devstack cinder-volume[88746]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 31 10:48:58 devstack cinder-volume[88746]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 31 10:48:58 devstack cinder-volume[88746]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 31 10:48:58 devstack cinder-volume[88746]: INFO dbcounter [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Registered counter for database cinder Jul 31 10:48:58 devstack cinder-volume[88746]: DEBUG oslo_db.sqlalchemy.engines [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG dbcounter [-] [88746] Writer thread running {{(pid=88746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:48:59 devstack cinder-volume[88746]: INFO cinder.rpc [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 31 10:48:59 devstack cinder-volume[88746]: INFO cinder.rpc [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_db.sqlalchemy.engines [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:59 devstack cinder-volume[88746]: INFO cinder.volume.manager [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Determined volume DB was empty at startup. Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG cinder.volume.manager [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88746) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 31 10:48:59 devstack cinder-volume[88746]: WARNING stevedore.named [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 31 10:48:59 devstack cinder-volume[88746]: WARNING castellan.key_manager [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:48:59 devstack cinder-volume[88746]: WARNING cinder.keymgr.conf_key_mgr [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 31 10:48:59 devstack cinder-volume[88746]: INFO cinder.volume.manager [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_db.sqlalchemy.engines [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:59 devstack cinder-volume[88746]: INFO oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Starting 1 workers Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Started child 88837 {{(pid=88746) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Full set of CONF: {{(pid=88746) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] ******************************************************************************** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] Configuration options gathered from: {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 31 10:48:59 devstack cinder-volume[88837]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] ================================================================================ {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] allow_availability_zone_fallback = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] allow_compression_on_image_upload = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] allowed_direct_url_schemes = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] api_rate_limit = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] auth_strategy = keystone {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_availability_zone = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_host = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_stats_polling_interval = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backup_api_class = cinder.backup.api.API {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backup_name_template = backup-%s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backup_use_same_host = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backup_use_temp_snapshot = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] chap_password = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] chap_username = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_internal_tenant_project_id = ccad07be3d9241d8a0f2de617591d83e {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_internal_tenant_user_id = 378e2136e80d4ad782d74038d31110f3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cluster = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] compression_format = gzip {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] compute_api_class = cinder.compute.nova.API {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] config_dir = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] config_source = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] control_exchange = openstack {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] debug = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] default_availability_zone = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] default_group_type = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] default_volume_type = QuobyteHD {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] disk_geometry = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] driver_client_cert = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] driver_client_cert_key = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] driver_data_namespace = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] driver_ssl_cert_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] driver_ssl_cert_verify = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] driver_use_ssl = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] enable_new_services = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] enable_unsupported_driver = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] enabled_backends = ['QuobyteHD'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] enforce_multipath_for_image_xfer = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] filter_function = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_api_insecure = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_api_servers = ['http://192.168.122.88/image'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_api_ssl_compression = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_ca_certificates_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_catalog_info = image:glance:publicURL {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_num_retries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance_request_timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] goodness_function = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] graceful_shutdown_timeout = 5 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Starting volume driver QuobyteDriver (1.1.14) Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] group_api_class = cinder.group.api.API {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] host = devstack {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88837) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_compress_on_upload = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_conversion_address_space_limit = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_conversion_cpu_limit = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_conversion_disable = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_upload_use_cinder_backend = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_upload_use_internal_tenant = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_volume_cache_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_volume_cache_max_count = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] image_volume_cache_max_size_gb = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] init_host_max_objects_retrieval = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] instance_format = [instance: %(uuid)s] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] iscsi_target_flags = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] iscsi_write_cache = on {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] iser_helper = tgtadm {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] iser_ip_address = 192.168.122.88 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] iser_port = 3260 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_color = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_config_append = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_dir = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_options = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_rotate_interval = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_rotate_interval_type = days {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] log_rotation_type = none {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] max_age = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] max_logfile_count = 30 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] max_logfile_size_mb = 200 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] max_over_subscription_ratio = 20.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] message_reap_interval = 86400 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] message_ttl = 2592000 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] migration_create_volume_timeout_secs = 300 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] monkey_patch = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] monkey_patch_modules = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] my_ip = 192.168.122.88 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] no_snapshot_gb_quota = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] num_iser_scan_tries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] num_shell_tries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] num_volume_device_scan_tries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] nvmeof_conn_info_version = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] nvmet_ns_id = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] nvmet_port_id = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_max_limit = 1000 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_volume_ext_list = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_volume_listen_port = 8776 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_volume_use_ssl = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] osapi_volume_workers = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] per_volume_size_limit = -1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] periodic_fuzzy_delay = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] periodic_interval = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] public_endpoint = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] publish_errors = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_backup_gigabytes = 1000 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_backups = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_gigabytes = 1000 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_groups = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_snapshots = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] quota_volumes = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] rate_limit_burst = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] rate_limit_except_level = CRITICAL {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] rate_limit_interval = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] reinit_driver_count = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] replication_device = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] report_discard_supported = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] report_interval = 120 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] reservation_clean_interval = 86400 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] reservation_expire = 86400 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] reserved_image_namespaces = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] reserved_percentage = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] rpc_response_timeout = 120 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] run_external_periodic_tasks = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] scst_target_driver = iscsi {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] scst_target_iqn_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_down_time = 720 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] shell_completion = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] snapshot_name_template = snapshot-%s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] split_loggers = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] state_path = /opt/stack/data/cinder {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] storage_availability_zone = nova {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] storage_protocol = iSCSI {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] syslog_log_facility = LOG_USER {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] target_helper = lioadm {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] target_ip_address = 192.168.122.88 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] target_port = 3260 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] target_protocol = iscsi {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] target_secondary_ip_addresses = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] trace_flags = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] transport_url = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] until_refresh = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_chap_auth = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_default_quota_class = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_journal = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_json = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_multipath_for_image_xfer = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_stderr = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] use_syslog = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] verify_glance_signatures = enabled {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_api_class = cinder.volume.api.API {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_backend_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_clear = zero {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_clear_ionice = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_clear_size = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_copy_bps_limit = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_dd_blocksize = 1M {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_name_template = volume-%s {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_service_inithost_offload = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volume_usage_audit_period = month {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] zoning_mode = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_concurrency.disable_process_locking = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.auth_section = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.auth_type = password {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.auth_version = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.cache = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.include_service_catalog = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.insecure = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.interface = public {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_password = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcache_username = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.region_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.service_type = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.88/identity {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.backend = dogpile.cache.null {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.backend_argument = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.backend_expiration_time = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.config_prefix = cache.oslo {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.debug_cache_backend = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.enable_retry_client = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.enable_socket_keepalive = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88837) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 31 10:48:59 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 31 10:48:59 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Running cmd (subprocess): mount.quobyte {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.expiration_time = 600 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.hashclient_retry_attempts = 2 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_dead_retry = 300 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_pool_maxsize = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_sasl_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.password = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.proxies = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.redis_db = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.redis_server = localhost:6379 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.retry_attempts = 2 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.retry_delay = 0.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.socket_keepalive_count = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.socket_keepalive_idle = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.socket_keepalive_interval = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.socket_timeout = 1.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.tls_allowed_ciphers = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.tls_cafile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.tls_certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.tls_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.tls_keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cache.username = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] coordination.backend_url = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.asyncio_connection = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.asyncio_slave_connection = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.backend = sqlalchemy {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.connection = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.connection_debug = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.connection_parameters = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.connection_recycle_time = 3600 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.connection_trace = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.db_inc_retry_interval = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.db_max_retries = 20 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.db_max_retry_interval = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.db_retry_interval = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.max_overflow = 50 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.max_pool_size = 5 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.max_retries = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.mysql_wsrep_sync_wait = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.pool_timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.retry_interval = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.slave_connection = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.sqlite_synchronous = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.synchronous_reader = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] database.use_db_reconnect = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.connection_string = messaging:// {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.es_doc_type = notification {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.es_scroll_size = 10000 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.es_scroll_time = 2m {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.filter_error_trace = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.hmac_keys = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.sentinel_service_name = mymaster {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.socket_timeout = 0.1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.trace_requests = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler.trace_sqlalchemy = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler_jaeger.process_tags = {} {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler_jaeger.service_name_prefix = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] profiler_otlp.service_name_prefix = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.enforce_new_defaults = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.policy_default_rule = default {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.policy_file = policy.yaml {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.group = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.helper_command = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] privsep_osbrick.user = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.group = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.helper_command = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] cinder_sys_admin.user = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.auth_section = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.auth_type = password {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.cafile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.collect_timing = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.insecure = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.send_service_user_token = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.split_loggers = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] service_user.timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.auth_section = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.auth_type = password {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.collect_timing = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.insecure = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.region_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.split_loggers = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] glance.timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.backend_availability_zone = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.chap_password = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.chap_username = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.disk_geometry = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.driver_client_cert = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.driver_client_cert_key = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.driver_data_namespace = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.driver_use_ssl = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.extra_capabilities = {} {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.filter_function = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack quobyte-client[88838]: Reading configuration file: /etc/quobyte/client.cfg Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.goodness_function = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack quobyte-client[88838]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.iscsi_target_flags = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.iscsi_write_cache = on {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.iser_helper = tgtadm {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] CMD "mount.quobyte" returned: 1 in 0.049s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.iser_ip_address = 192.168.122.88 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.iser_port = 3260 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_host = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_login = admin {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_mount_options = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_password = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_private_key = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_share_path = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.num_shell_tries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.quobyte_volume_url = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.replication_device = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.report_discard_supported = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.reserved_percentage = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.target_helper = tgtadm {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.target_ip_address = 192.168.122.88 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.target_port = 3260 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.target_protocol = iscsi {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.trace_flags = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.unique_fqdn_network = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.use_chap_auth = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_backend_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_clear = zero {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_clear_ionice = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_clear_size = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_reports.file_event_handler = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_reports.log_dir = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.backend_availability_zone = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.backend_host = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.chap_password = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.chap_username = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.chiscsi_conf = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.disk_geometry = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.driver_client_cert = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.driver_data_namespace = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.driver_use_ssl = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.extra_capabilities = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.filter_function = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.goodness_function = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.iser_helper = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.iser_ip_address = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.iser_port = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.iser_target_prefix = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_host = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_login = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_mount_options = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_password = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:48:59 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_private_key = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_share_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_ssh_port = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.num_shell_tries = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.nvmet_port_id = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.replication_device = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.report_discard_supported = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.reserved_percentage = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.scst_target_driver = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.storage_protocol = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.target_helper = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.target_ip_address = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.target_port = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.target_prefix = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.target_protocol = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.trace_flags = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.use_chap_auth = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_clear = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_clear_size = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] QuobyteHD.volumes_dir = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_notifications.driver = [] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_notifications.retry = -1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] key_manager.fixed_key = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.barbican_api_version = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.barbican_endpoint = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.barbican_endpoint_type = public {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.barbican_region_name = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.cafile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.collect_timing = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.insecure = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.number_of_retries = 60 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.retry_delay = 1 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.send_service_user_token = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.split_loggers = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.verify_ssl = True {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican.verify_ssl_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.auth_section = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.auth_type = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.cafile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.certfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.collect_timing = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.insecure = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.keyfile = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.split_loggers = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] barbican_service_user.timeout = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.approle_role_id = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.approle_secret_id = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.auth_method = approle {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.auth_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.kv_mountpoint = secret {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.kv_path = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.kv_version = 2 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.namespace = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.root_token_id = **** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.ssl_ca_crt_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.timeout = 60.0 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.token_file = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.token_role = None {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.use_ssl = False {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 31 10:48:59 devstack cinder-volume[88746]: DEBUG oslo_service.backend._eventlet.service [None req-19d885f9-fb4d-4bdb-86c9-5ce1319ab301 None None] ******************************************************************************** {{(pid=88746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 31 10:48:59 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.244s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:48:59 devstack cinder-volume[88837]: INFO cinder.volume.driver [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Driver hasn't implemented _init_vendor_properties() Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.driver [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5441589355469, 'free_capacity_gb': 1775.5441589355469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88837) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_db.sqlalchemy.engines [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88837) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writer thread running {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.db.api [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Building query based on filter {{(pid=88837) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88837) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:48:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:48:59 devstack cinder-volume[88837]: INFO cinder.keymgr.migration [None req-016fe554-e0a3-487e-9a4a-511d6b252307 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 31 10:48:59 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:48:59 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:00 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.225s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:49:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Driver initialization completed successfully. Jul 31 10:49:00 devstack cinder-volume[88837]: INFO cinder.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Initiating service 3 cleanup Jul 31 10:49:00 devstack cinder-volume[88837]: INFO cinder.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Service 3 cleanup completed. Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG cinder.service [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Creating RPC server for service cinder-volume {{(pid=88837) start /opt/stack/cinder/cinder/service.py:231}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG cinder.service [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88837) start /opt/stack/cinder/cinder/service.py:237}} Jul 31 10:49:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:49:00 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:49:00 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:49:00 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 31 10:49:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.236s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:49:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-88ec7e9b-43fc-4444-9eeb-4bec3f180d2a None None] Driver post RPC initialization completed successfully. Jul 31 10:49:09 devstack cinder-volume[88746]: DEBUG dbcounter [-] [88746] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:10 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:10 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:49:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:49:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 6 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:49:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:50:46 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:50:46 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:50:46 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.266s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 6 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:50:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:51:10 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:51:10 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:46 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:51:46 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:47 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.523s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Flow 'volume_create_manager' (675e4487-1fef-49f6-b994-608f985da545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eed5af9-7b23-421d-a6af-3fcd14fd2338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eed5af9-7b23-421d-a6af-3fcd14fd2338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1531419046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8172a0f-3239-4e82-9342-7015f5e84c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0edc53bfc8e4cd7a36ecd3c8299d14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:55Z,use_quota=True,user_id='3f9585926bcb456187333bc608d817ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2c1251-c122-4957-a819-549661a01a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2c1251-c122-4957-a819-549661a01a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9595783-c4c0-44fe-b243-1ea57bbec03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9595783-c4c0-44fe-b243-1ea57bbec03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8172a0f-3239-4e82-9342-7015f5e84c6d', 'volume_name': 'volume-e8172a0f-3239-4e82-9342-7015f5e84c6d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ae6e26-8d48-45a9-89be-1737ffe68f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ae6e26-8d48-45a9-89be-1737ffe68f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128fb183-75ba-4c11-9ffd-b77a90047db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Volume e8172a0f-3239-4e82-9342-7015f5e84c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8172a0f-3239-4e82-9342-7015f5e84c6d', 'volume_size': 1} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1531419046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8172a0f-3239-4e82-9342-7015f5e84c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0edc53bfc8e4cd7a36ecd3c8299d14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:55Z,use_quota=True,user_id='3f9585926bcb456187333bc608d817ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Creating volume e8172a0f-3239-4e82-9342-7015f5e84c6d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:51:55 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:51:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:55 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d 1073741824 Jul 31 10:51:55 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Flow 'volume_create_manager' (bf8c3c2e-733f-4b90-9261-89af98bf3cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddbed46-1dc5-4adf-ba5f-3532badd14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddbed46-1dc5-4adf-ba5f-3532badd14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-6575188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06373051-c060-4b72-a5a6-4e106d1a50ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da8b7ac6fed4062930c84105ca43597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:57Z,use_quota=True,user_id='088f800efcb7414ea19013e78a341580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d6cce1-b53d-4188-a5c9-20ebdda740b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d6cce1-b53d-4188-a5c9-20ebdda740b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af22a5e-c493-4f06-b65d-68a504a3575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af22a5e-c493-4f06-b65d-68a504a3575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06373051-c060-4b72-a5a6-4e106d1a50ca', 'volume_name': 'volume-06373051-c060-4b72-a5a6-4e106d1a50ca', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fc7541-e245-48c9-89a9-892e2633af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fc7541-e245-48c9-89a9-892e2633af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c443e2-1b1f-4fed-b071-a5a0b09c8010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Volume 06373051-c060-4b72-a5a6-4e106d1a50ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06373051-c060-4b72-a5a6-4e106d1a50ca', 'volume_size': 1} Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:56 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d 1073741824" returned: 0 in 1.272s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:57 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d Jul 31 10:51:57 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:57 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d" returned: 0 in 0.661s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-6575188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06373051-c060-4b72-a5a6-4e106d1a50ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da8b7ac6fed4062930c84105ca43597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:51:57Z,use_quota=True,user_id='088f800efcb7414ea19013e78a341580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Creating volume 06373051-c060-4b72-a5a6-4e106d1a50ca {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:51:57 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:57 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca 1073741824 Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128fb183-75ba-4c11-9ffd-b77a90047db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8172a0f-3239-4e82-9342-7015f5e84c6d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:57 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e63c3a-c798-45d2-95c3-ffd7ef600f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Volume volume-e8172a0f-3239-4e82-9342-7015f5e84c6d (e8172a0f-3239-4e82-9342-7015f5e84c6d): created successfully Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e63c3a-c798-45d2-95c3-ffd7ef600f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Flow 'volume_create_manager' (675e4487-1fef-49f6-b994-608f985da545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-dab65b09-ecb2-4e6f-a7ba-47ada39aff3e tempest-DeleteServersTestJSON-233286641 None] Created volume successfully. Jul 31 10:51:58 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca 1073741824" returned: 0 in 0.775s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:51:58 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca Jul 31 10:51:58 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:51:59 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca" returned: 0 in 0.763s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c443e2-1b1f-4fed-b071-a5a0b09c8010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06373051-c060-4b72-a5a6-4e106d1a50ca', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eaeef7-e46d-498a-a64c-7a002a2bde01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:51:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Volume volume-06373051-c060-4b72-a5a6-4e106d1a50ca (06373051-c060-4b72-a5a6-4e106d1a50ca): created successfully Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eaeef7-e46d-498a-a64c-7a002a2bde01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:51:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Flow 'volume_create_manager' (bf8c3c2e-733f-4b90-9261-89af98bf3cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:51:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-05822ff9-a069-41a2-b880-b267b19ee238 tempest-VolumesAdminNegativeTest-357500953 None] Created volume successfully. Jul 31 10:52:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Acquiring lock "cinder-06373051-c060-4b72-a5a6-4e106d1a50ca-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Lock "cinder-06373051-c060-4b72-a5a6-4e106d1a50ca-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Acquiring lock "cinder-quobyte-06373051-c060-4b72-a5a6-4e106d1a50ca" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Lock "cinder-quobyte-06373051-c060-4b72-a5a6-4e106d1a50ca" acquired by "delete_volume" :: waited 0.075s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:01 devstack cinder-volume[88837]: INFO oslo.privsep.daemon [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa5pw0_mw/privsep.sock'] Jul 31 10:52:01 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa5pw0_mw/privsep.sock Jul 31 10:52:01 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: Jul 31 10:52:04 devstack cinder-volume[88837]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 31 10:52:05 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:05 devstack cinder-volume[88837]: INFO oslo.privsep.daemon [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Spawned new privsep daemon via rootwrap Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Accepted privsep connection to /tmp/tmpa5pw0_mw/privsep.sock {{(pid=88837) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 31 10:52:05 devstack cinder-volume[88837]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 31 10:52:05 devstack cinder-volume[88837]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 31 10:52:05 devstack cinder-volume[88837]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 31 10:52:05 devstack cinder-volume[88837]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90321 Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf8c732-84a5-4897-9b1e-f2da73be24d4]: (2,) {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb0a93-8c61-4bd1-aaaa-eed0342c188c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:05 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca Jul 31 10:52:05 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:05 devstack cinder-volume[88837]: WARNING py.warnings [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 31 10:52:05 devstack cinder-volume[88837]: .first() Jul 31 10:52:05 devstack cinder-volume[88837]: Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed0693-0a56-4dea-904c-223dc3f6016d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:05 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca" returned: 0 in 0.927s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:06 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca Jul 31 10:52:06 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:06 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d Jul 31 10:52:06 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:06 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-06373051-c060-4b72-a5a6-4e106d1a50ca" returned: 0 in 0.553s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Lock "cinder-quobyte-06373051-c060-4b72-a5a6-4e106d1a50ca" released by "delete_volume" :: held 5.440s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:06 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d" returned: 0 in 0.781s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:06 devstack cinder-volume[88837]: WARNING cinder.quota [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:52:06 devstack cinder-volume[88837]: WARNING cinder.quota [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Created reservations ['b45b9414-1da8-4a6f-858a-b5becd404d4b', '43762b59-2051-42e0-96fa-965f4a05d571', 'de9fa727-6b1f-46f4-85e6-868e213a1a79', '03e8e17b-faba-4e99-af0a-4755b419b609'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-e8172a0f-3239-4e82-9342-7015f5e84c6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56c3219d-e2d1-4e8d-9e95-e0be474a9723', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:07 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:52:07 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-b9828d20-cb62-49db-9506-207200e2e119 req-1bb52c17-0564-4218-8baf-44c5ed749756 tempest-DeleteServersTestJSON-233286641 None] attachment_update completed successfully. Jul 31 10:52:07 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Deleted volume successfully. Jul 31 10:52:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2fce4d61-2cae-4984-a636-ae751b2ce00f tempest-VolumesAdminNegativeTest-357500953 None] Lock "cinder-06373051-c060-4b72-a5a6-4e106d1a50ca-delete_volume" released by "delete_volume" :: held 6.871s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:13 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-56e437f2-4b71-4be6-a1f6-402ab3fb8be0 req-8edee529-f25e-4ee5-8129-e9b44f2ed109 tempest-DeleteServersTestJSON-233286641 None] Terminate volume connection completed successfully. Jul 31 10:52:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-56e437f2-4b71-4be6-a1f6-402ab3fb8be0 req-8edee529-f25e-4ee5-8129-e9b44f2ed109 tempest-DeleteServersTestJSON-233286641 None] Deleting attachment 56c3219d-e2d1-4e8d-9e95-e0be474a9723. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:52:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Acquiring lock "cinder-e8172a0f-3239-4e82-9342-7015f5e84c6d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Lock "cinder-e8172a0f-3239-4e82-9342-7015f5e84c6d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Acquiring lock "cinder-quobyte-e8172a0f-3239-4e82-9342-7015f5e84c6d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:52:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Lock "cinder-quobyte-e8172a0f-3239-4e82-9342-7015f5e84c6d" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:52:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[65947c8b-4fd7-4c82-94e5-697e6f2e518d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:52:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:15 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d Jul 31 10:52:15 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:15 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d" returned: 0 in 0.403s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:15 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d Jul 31 10:52:15 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:15 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e8172a0f-3239-4e82-9342-7015f5e84c6d" returned: 0 in 0.305s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Lock "cinder-quobyte-e8172a0f-3239-4e82-9342-7015f5e84c6d" released by "delete_volume" :: held 0.757s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Created reservations ['53a20e5e-7521-4967-93d2-443f09a5b578', '15dbf581-1e11-4b09-b3a9-c1b5993f492d', '98daf193-4d58-4788-9aca-141da717cbe9', 'e5e93a3b-23ff-425f-a209-3689befd1bd0'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:15 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:52:15 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:16 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.285s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:16 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Deleted volume successfully. Jul 31 10:52:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d4fc615-ffa2-4e5f-8864-2a91ce121a29 tempest-DeleteServersTestJSON-233286641 None] Lock "cinder-e8172a0f-3239-4e82-9342-7015f5e84c6d-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:52:25 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:DELETE=1,cinder:INSERT=4 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=25,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Flow 'volume_create_manager' (66c8a6cb-bb4b-4f73-8c3f-03687ebaf004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd259c7-5349-4f6e-9f1a-1783c856c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd259c7-5349-4f6e-9f1a-1783c856c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1602799386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1630eb-1d60-41ef-b086-fde1022564de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c594190dec4a2b97fd688ea89f6372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:27Z,use_quota=True,user_id='addf816b55b54521a515c44d06444adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4714cc8-3882-44a6-8a77-174a3e648fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4714cc8-3882-44a6-8a77-174a3e648fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd0f36f-c4f3-44bb-a4a6-1ceae6c8f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd0f36f-c4f3-44bb-a4a6-1ceae6c8f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c1630eb-1d60-41ef-b086-fde1022564de', 'volume_name': 'volume-6c1630eb-1d60-41ef-b086-fde1022564de', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc18dcba-6cd1-4fe4-9cd9-2200833660c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc18dcba-6cd1-4fe4-9cd9-2200833660c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c96e1c-0183-422e-a726-925713244623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Volume 6c1630eb-1d60-41ef-b086-fde1022564de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c1630eb-1d60-41ef-b086-fde1022564de', 'volume_size': 1} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1602799386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1630eb-1d60-41ef-b086-fde1022564de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48c594190dec4a2b97fd688ea89f6372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:52:27Z,use_quota=True,user_id='addf816b55b54521a515c44d06444adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Creating volume 6c1630eb-1d60-41ef-b086-fde1022564de {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:52:26 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:52:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:26 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de 1073741824 Jul 31 10:52:26 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:27 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de 1073741824" returned: 0 in 0.581s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:27 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de Jul 31 10:52:27 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:27 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de" returned: 0 in 0.343s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c96e1c-0183-422e-a726-925713244623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1630eb-1d60-41ef-b086-fde1022564de', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99f132b-0752-4494-9ab6-8499586b819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:52:27 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Volume volume-6c1630eb-1d60-41ef-b086-fde1022564de (6c1630eb-1d60-41ef-b086-fde1022564de): created successfully Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99f132b-0752-4494-9ab6-8499586b819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:52:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Flow 'volume_create_manager' (66c8a6cb-bb4b-4f73-8c3f-03687ebaf004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:52:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d42f2ad6-005c-49c5-b548-48397f79b653 tempest-AttachVolumeShelveTestJSON-1062043883 None] Created volume successfully. Jul 31 10:52:37 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:37 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:52:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-9ee02146-6202-489e-91fc-78c802b78593 req-ccbb3d39-ea3c-40bc-bf2f-952ae8a9614f tempest-AttachVolumeShelveTestJSON-1062043883 None] No connector for attachment 6ca3dbf3-339a-4fd7-bb81-e60161636787; skipping storage backend terminate_connection call. {{(pid=88837) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 31 10:52:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-9ee02146-6202-489e-91fc-78c802b78593 req-ccbb3d39-ea3c-40bc-bf2f-952ae8a9614f tempest-AttachVolumeShelveTestJSON-1062043883 None] Deleting attachment 6ca3dbf3-339a-4fd7-bb81-e60161636787. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:52:46 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:52:46 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:52:46 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 8 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:52:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:52:55 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Flow 'volume_create_manager' (a2d9f375-3a8a-4313-a13e-29dd31d6847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a7bb49-bd4b-4ef5-84a2-723524c4c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a7bb49-bd4b-4ef5-84a2-723524c4c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1680275362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b48bd85-827c-4a92-8cd7-5e491bb50413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e8e281e3254f92aac183458502a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:08Z,use_quota=True,user_id='79c6b84205c94d7594eb7dba5f06354f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af82337a-73ba-4d9d-9599-257aff9ac149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af82337a-73ba-4d9d-9599-257aff9ac149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178275ef-a8a6-4ecf-87f5-36f480fd24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178275ef-a8a6-4ecf-87f5-36f480fd24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b48bd85-827c-4a92-8cd7-5e491bb50413', 'volume_name': 'volume-4b48bd85-827c-4a92-8cd7-5e491bb50413', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57629d3-9646-444f-a8e7-d92fabeafa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57629d3-9646-444f-a8e7-d92fabeafa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca5c16d-dc2e-4b6b-93e2-e3b2b4689a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Volume 4b48bd85-827c-4a92-8cd7-5e491bb50413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b48bd85-827c-4a92-8cd7-5e491bb50413', 'volume_size': 1} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1680275362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b48bd85-827c-4a92-8cd7-5e491bb50413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e8e281e3254f92aac183458502a2f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:08Z,use_quota=True,user_id='79c6b84205c94d7594eb7dba5f06354f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Creating volume 4b48bd85-827c-4a92-8cd7-5e491bb50413 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:53:08 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:53:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:08 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 1073741824 Jul 31 10:53:08 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:09 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 1073741824" returned: 0 in 1.165s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:09 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 Jul 31 10:53:09 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:10 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413" returned: 0 in 0.527s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca5c16d-dc2e-4b6b-93e2-e3b2b4689a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b48bd85-827c-4a92-8cd7-5e491bb50413', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb885dd-ed93-44de-8849-9bfa6550928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:10 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Volume volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 (4b48bd85-827c-4a92-8cd7-5e491bb50413): created successfully Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb885dd-ed93-44de-8849-9bfa6550928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Flow 'volume_create_manager' (a2d9f375-3a8a-4313-a13e-29dd31d6847e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ac8efe3d-9dc8-4956-bff3-d88db06b2a2a tempest-TaggedAttachmentsTest-673862961 None] Created volume successfully. Jul 31 10:53:20 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:20 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Flow 'volume_create_manager' (96a5b270-e146-469c-b04e-971bd09aadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66708eda-6e15-44c2-9a48-56dfc6591c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66708eda-6e15-44c2-9a48-56dfc6591c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-637918253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef386c09-45f4-471e-8b6b-fb1abb0b676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1bf5875fa36448d944d6a3298674962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:25Z,use_quota=True,user_id='cb99394b9b50453f9c6b1f1be27d0666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d60d2d-307c-4b14-9953-3c9317b4c6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d60d2d-307c-4b14-9953-3c9317b4c6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383028c0-89da-412e-b7c6-0b0c3a08b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383028c0-89da-412e-b7c6-0b0c3a08b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef386c09-45f4-471e-8b6b-fb1abb0b676f', 'volume_name': 'volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033c5e1e-d99d-42e5-8d7d-7e87011edb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033c5e1e-d99d-42e5-8d7d-7e87011edb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdee8fd-170a-43d6-bbfe-96993134588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:25 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Volume ef386c09-45f4-471e-8b6b-fb1abb0b676f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f', 'volume_size': 1} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-637918253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef386c09-45f4-471e-8b6b-fb1abb0b676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1bf5875fa36448d944d6a3298674962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:25Z,use_quota=True,user_id='cb99394b9b50453f9c6b1f1be27d0666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Creating volume ef386c09-45f4-471e-8b6b-fb1abb0b676f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:53:25 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:53:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:25 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f 1073741824 Jul 31 10:53:25 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:27 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f 1073741824" returned: 0 in 1.471s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:27 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f Jul 31 10:53:27 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:27 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f" returned: 0 in 0.701s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdee8fd-170a-43d6-bbfe-96993134588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950811e6-9f8b-4b5f-a53d-8dc920ca18ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Volume volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f (ef386c09-45f4-471e-8b6b-fb1abb0b676f): created successfully Jul 31 10:53:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950811e6-9f8b-4b5f-a53d-8dc920ca18ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Flow 'volume_create_manager' (96a5b270-e146-469c-b04e-971bd09aadba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5ceb96f0-a9df-4cf5-9a74-32716cafc7f2 tempest-ServerActionsTestOtherA-1867674029 None] Created volume successfully. Jul 31 10:53:38 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:38 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:46 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:53:46 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Acquiring lock "cinder-6c1630eb-1d60-41ef-b086-fde1022564de-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "cinder-6c1630eb-1d60-41ef-b086-fde1022564de-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Acquiring lock "cinder-quobyte-6c1630eb-1d60-41ef-b086-fde1022564de" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "cinder-quobyte-6c1630eb-1d60-41ef-b086-fde1022564de" acquired by "delete_volume" :: waited 0.058s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e26fb8-c172-409a-9647-072a54b3dfdc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:47 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de Jul 31 10:53:47 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:47 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.511s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 8 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:53:47 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de" returned: 0 in 0.408s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:47 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de Jul 31 10:53:47 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:47 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c1630eb-1d60-41ef-b086-fde1022564de" returned: 0 in 0.244s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "cinder-quobyte-6c1630eb-1d60-41ef-b086-fde1022564de" released by "delete_volume" :: held 0.780s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Created reservations ['9407a3cc-a43a-44a3-8e2b-1b5515576030', '884c02a8-abe5-4622-b71e-301170661bc6', '394f87c3-49ea-4f35-b46a-2106de141199', 'ca064817-a929-4dbd-92d1-cf121a46b03a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:47 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:53:47 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:47 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.266s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:53:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Deleted volume successfully. Jul 31 10:53:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-20f291f4-f5f4-4c4c-96f1-fab35c7c698e tempest-AttachVolumeShelveTestJSON-1062043883 None] Lock "cinder-6c1630eb-1d60-41ef-b086-fde1022564de-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Flow 'volume_create_manager' (3917474f-c13f-4805-a845-48db4cfe5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea01f4cc-bcf7-4509-82d8-63708ad45df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea01f4cc-bcf7-4509-82d8-63708ad45df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1378506364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cf133a-4587-4224-9285-999e2ce33170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cabb9b447bec49428a856b9101dc7a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:56Z,use_quota=True,user_id='c3af01a326ae4c679233c3b874292980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65000eb0-8439-496e-8310-8e2342aa4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65000eb0-8439-496e-8310-8e2342aa4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e84a2-8519-4708-ac45-62e205daaf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057e84a2-8519-4708-ac45-62e205daaf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cf133a-4587-4224-9285-999e2ce33170', 'volume_name': 'volume-73cf133a-4587-4224-9285-999e2ce33170', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1f1188-5180-4775-a4e3-886d59e9b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1f1188-5180-4775-a4e3-886d59e9b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2c677a-3798-42b8-ba2e-835cb628e099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Volume 73cf133a-4587-4224-9285-999e2ce33170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cf133a-4587-4224-9285-999e2ce33170', 'volume_size': 1} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1378506364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cf133a-4587-4224-9285-999e2ce33170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cabb9b447bec49428a856b9101dc7a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:56Z,use_quota=True,user_id='c3af01a326ae4c679233c3b874292980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Creating volume 73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:53:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:56 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 1073741824 Jul 31 10:53:56 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:56 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 1073741824" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:56 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 Jul 31 10:53:56 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:56 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2c677a-3798-42b8-ba2e-835cb628e099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cf133a-4587-4224-9285-999e2ce33170', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eaf8e1d-943c-49be-b541-588608b0cbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Volume volume-73cf133a-4587-4224-9285-999e2ce33170 (73cf133a-4587-4224-9285-999e2ce33170): created successfully Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eaf8e1d-943c-49be-b541-588608b0cbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Flow 'volume_create_manager' (3917474f-c13f-4805-a845-48db4cfe5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-62fee2f6-dbc6-4467-88a4-b8a41a28399e req-21efbd3f-4ed3-441a-bf23-75ef50bd69f1 tempest-VolumesSnapshotsTestJSON-975186103 None] Created volume successfully. Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Flow 'volume_create_manager' (9574fae0-2ba8-4411-a426-db4e2386df11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612a3da1-5a41-43f5-8ad0-22c348fa8209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612a3da1-5a41-43f5-8ad0-22c348fa8209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-852882716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade155e6-d44c-44cc-a956-e79160cab21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc4f114227d4fd09efaf80bcc758a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:57Z,use_quota=True,user_id='e78313ab0cf84f3db51f866f43df88e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263a3eb1-f8e6-4539-a4b2-37092e47f0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263a3eb1-f8e6-4539-a4b2-37092e47f0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27ad49-0084-40f4-b883-5e91a4b8c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27ad49-0084-40f4-b883-5e91a4b8c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade155e6-d44c-44cc-a956-e79160cab21f', 'volume_name': 'volume-ade155e6-d44c-44cc-a956-e79160cab21f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53253fdf-b500-4207-97f0-d66de0d394dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53253fdf-b500-4207-97f0-d66de0d394dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d9e75c-0a62-4500-9530-5d057cd79cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Volume ade155e6-d44c-44cc-a956-e79160cab21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade155e6-d44c-44cc-a956-e79160cab21f', 'volume_size': 1} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-852882716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade155e6-d44c-44cc-a956-e79160cab21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc4f114227d4fd09efaf80bcc758a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:53:57Z,use_quota=True,user_id='e78313ab0cf84f3db51f866f43df88e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Creating volume ade155e6-d44c-44cc-a956-e79160cab21f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:53:57 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:53:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:57 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f 1073741824 Jul 31 10:53:57 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:58 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f 1073741824" returned: 0 in 0.484s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:58 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f Jul 31 10:53:58 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:58 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f" returned: 0 in 0.563s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d9e75c-0a62-4500-9530-5d057cd79cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade155e6-d44c-44cc-a956-e79160cab21f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b91fbc-d4c5-45c3-b965-9f25dea724dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:53:58 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Volume volume-ade155e6-d44c-44cc-a956-e79160cab21f (ade155e6-d44c-44cc-a956-e79160cab21f): created successfully Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b91fbc-d4c5-45c3-b965-9f25dea724dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Flow 'volume_create_manager' (9574fae0-2ba8-4411-a426-db4e2386df11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:53:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f206d9bc-6b65-4d3f-a742-7fb80da97f65 tempest-AttachVolumeNegativeTest-406109207 None] Created volume successfully. Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Creating offline snapshot a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 of volume 73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b073a9-782a-4f7f-a3f1-26d94450df35]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:53:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:59 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 Jul 31 10:53:59 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:53:59 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Jul 31 10:53:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170" returned: 0 in 0.544s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:53:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:53:59 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 1G Jul 31 10:53:59 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:00 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 1G" returned: 0 in 0.656s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cf133a-4587-4224-9285-999e2ce33170 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:00 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cf133a-4587-4224-9285-999e2ce33170 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 Jul 31 10:54:00 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:00 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cf133a-4587-4224-9285-999e2ce33170 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" returned: 0 in 0.345s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:00 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 is being set with open permissions: ugo+rw Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:00 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 Jul 31 10:54:00 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:00 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" returned: 0 in 0.267s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:00 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info Jul 31 10:54:00 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:01 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:01 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info is being set with open permissions: ugo+rw Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info Jul 31 10:54:01 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.info" returned: 0 in 0.280s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.973s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf6417-2525-4dbd-a844-184d03db1d10]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-73b3af92-215f-49b8-894f-6334db790529 req-e0e0e941-c50d-46dc-a7ec-d6169878b45d tempest-VolumesSnapshotsTestJSON-975186103 None] Create snapshot completed successfully Jul 31 10:54:01 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 Jul 31 10:54:01 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:01 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413" returned: 0 in 0.406s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.438s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.790s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d10986-820a-456e-b731-b9903a1c1ce5]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-4b48bd85-827c-4a92-8cd7-5e491bb50413', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45d8fa93-ec80-4a2a-aed9-a874004440af', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:54:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-87b920d1-ca6a-4b3c-b5a1-91742a4ec11a req-0f7924ca-0f74-41b1-8d9d-b2f77f8e8787 tempest-TaggedAttachmentsTest-673862961 None] attachment_update completed successfully. Jul 31 10:54:02 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f Jul 31 10:54:02 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "cinder-a6cb5be4-97c4-4b60-bcd4-7225eec18dd5-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-a6cb5be4-97c4-4b60-bcd4-7225eec18dd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "cinder-quobyte-73cf133a-4587-4224-9285-999e2ce33170" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-quobyte-73cf133a-4587-4224-9285-999e2ce33170" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "cinder-quobyte-a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-quobyte-a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:02 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Deleting offline snapshot a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 of volume 73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] snapshot_file for this snap is: volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f" returned: 0 in 0.549s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.574s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2396b9-e70e-4824-a99d-298ccaeb0836]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-ade155e6-d44c-44cc-a956-e79160cab21f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16a0c6f0-e73f-4d66-9046-71965343859d', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:54:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-1fe215b1-5c3d-4994-b9d3-a4f5a368ad33 req-d6c89a3d-4ff6-4646-8ec7-10c48393091d tempest-AttachVolumeNegativeTest-406109207 None] attachment_update completed successfully. Jul 31 10:54:02 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 Jul 31 10:54:02 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:02 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" returned: 0 in 0.495s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73cf133a-4587-4224-9285-999e2ce33170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:54:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[692105f5-b2f8-439d-bd80-2a8a570e42f3]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:03 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 Jul 31 10:54:03 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:03 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170" returned: 0 in 0.545s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:03 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 Jul 31 10:54:03 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:03 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" returned: 0 in 0.428s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:04 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5 Jul 31 10:54:04 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:04 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170.a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" returned: 0 in 0.236s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-quobyte-a6cb5be4-97c4-4b60-bcd4-7225eec18dd5" released by "_delete_snapshot" :: held 1.840s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-quobyte-73cf133a-4587-4224-9285-999e2ce33170" released by "delete_snapshot" :: held 1.877s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:04 devstack cinder-volume[88837]: WARNING cinder.quota [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.quota [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Created reservations ['c6a54a66-e354-4059-ad78-0c813efc5767', '2c5b0817-a12b-4378-8796-611b6295f006', 'f906d012-f312-4fa3-a06e-79f372a8ae76', '65db4b29-c93b-4b97-8d52-44a9cac27b59'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Delete snapshot completed successfully. Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-45b707ee-ade6-4009-a536-204e3131f2b4 req-55747354-5d8a-487c-9c4b-162419f5da31 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-a6cb5be4-97c4-4b60-bcd4-7225eec18dd5-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "cinder-73cf133a-4587-4224-9285-999e2ce33170-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-73cf133a-4587-4224-9285-999e2ce33170-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "cinder-quobyte-73cf133a-4587-4224-9285-999e2ce33170" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-quobyte-73cf133a-4587-4224-9285-999e2ce33170" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bccc8e0-e12c-4b2d-9c91-4188bd03981f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:05 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 Jul 31 10:54:05 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:05 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170" returned: 0 in 0.479s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:05 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170 Jul 31 10:54:05 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:05 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-73cf133a-4587-4224-9285-999e2ce33170" returned: 0 in 0.344s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-quobyte-73cf133a-4587-4224-9285-999e2ce33170" released by "delete_volume" :: held 0.926s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG cinder.quota [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Created reservations ['094c76d7-8267-4755-b81a-22ff06d1f8c7', '98bdc6c2-cb14-4cf1-9a45-6bce9db96190', '0c62920b-07af-4d3d-a49a-9328fa572959', '6efa4194-aea2-4af9-bbb5-500db56d901a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:06 devstack sudo[92412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:54:06 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-58702961-2063-4865-a64a-0ecb69708449 req-1c6c58dc-d23f-469f-ab7a-65024929d38c tempest-TaggedAttachmentsTest-673862961 None] Terminate volume connection completed successfully. Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-58702961-2063-4865-a64a-0ecb69708449 req-1c6c58dc-d23f-469f-ab7a-65024929d38c tempest-TaggedAttachmentsTest-673862961 None] Deleting attachment 45d8fa93-ec80-4a2a-aed9-a874004440af. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:54:06 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.329s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG cinder.manager [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Deleted volume successfully. Jul 31 10:54:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-1c9f06bd-a2cf-4a3c-bec8-41addf678f2a req-5bb1f729-30d9-40c8-bd88-031fd2ede472 tempest-VolumesSnapshotsTestJSON-975186103 None] Lock "cinder-73cf133a-4587-4224-9285-999e2ce33170-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f94c08a-162a-445a-bd91-bf7a259e19c1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:07 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f Jul 31 10:54:07 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:07 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f" returned: 0 in 0.505s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.545s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dec6a302-d6be-4e70-8696-7de6d4bc53fc', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:54:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-ef3ec9bc-b4ff-4060-9d63-b3e37a5abf2f req-8901536f-947f-4eb2-81d8-760588445b55 tempest-ServerActionsTestOtherA-1867674029 None] attachment_update completed successfully. Jul 31 10:54:13 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-5e80d427-f107-46e5-b8dc-7995cc84505f tempest-ServerActionsTestOtherA-1867674029 None] Terminate volume connection completed successfully. Jul 31 10:54:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-5e80d427-f107-46e5-b8dc-7995cc84505f tempest-ServerActionsTestOtherA-1867674029 None] Deleting attachment dec6a302-d6be-4e70-8696-7de6d4bc53fc. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:54:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a680057-2ba6-461d-960a-6a37c822634c tempest-GroupSnapshotsTest-1748992447 None] Group tempest-GroupSnapshotsTest-Group-1535437275: creating Jul 31 10:54:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a680057-2ba6-461d-960a-6a37c822634c tempest-GroupSnapshotsTest-1748992447 None] Group tempest-GroupSnapshotsTest-Group-1535437275: created successfully Jul 31 10:54:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a680057-2ba6-461d-960a-6a37c822634c tempest-GroupSnapshotsTest-1748992447 None] Create group completed successfully. Jul 31 10:54:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724f789-d330-42da-9d38-c1ccb24d8a63]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:15 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f Jul 31 10:54:15 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:15 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f" returned: 0 in 0.579s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.622s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b860a82-4711-48fb-9840-3d713e52c2a1', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:54:15 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-bd219bed-e1a9-487a-b2eb-5e265e41bf35 req-dc8a0b56-8bba-47c5-b85a-4a36c279ab49 tempest-ServerActionsTestOtherA-1867674029 None] attachment_update completed successfully. Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (c0e33396-7694-4a46-8c2a-fda102bfbfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66d0551-e5c7-4915-a30f-8c570c34a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66d0551-e5c7-4915-a30f-8c570c34a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938483318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7d0a5dc-e70f-41c4-b12d-9611c268cd93,host='devstack@QuobyteHD#QuobyteHD',id=92c008a9-f4c6-476d-9e49-c80fa4dcb4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:16Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a34899a-9b22-448b-83f7-bd1951636ee2),volume_type_id=8a34899a-9b22-448b-83f7-bd1951636ee2)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f120aaae-04d1-487d-a1bf-315ad4d81e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f120aaae-04d1-487d-a1bf-315ad4d81e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ecd9e5-c8d3-4afc-9958-021a9f315ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ecd9e5-c8d3-4afc-9958-021a9f315ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c008a9-f4c6-476d-9e49-c80fa4dcb4da', 'volume_name': 'volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5175f196-f336-47dd-9b36-5f70c77b942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5175f196-f336-47dd-9b36-5f70c77b942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7810f412-e1c1-4abe-83ad-c2b28e599f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:16 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Volume 92c008a9-f4c6-476d-9e49-c80fa4dcb4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da', 'volume_size': 1} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7d0a5dc-e70f-41c4-b12d-9611c268cd93,created_at=2026-07-31T08:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938483318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7d0a5dc-e70f-41c4-b12d-9611c268cd93,host='devstack@QuobyteHD#QuobyteHD',id=92c008a9-f4c6-476d-9e49-c80fa4dcb4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:16Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a34899a-9b22-448b-83f7-bd1951636ee2),volume_type_id=8a34899a-9b22-448b-83f7-bd1951636ee2)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Creating volume 92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:54:16 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:54:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:16 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da 1073741824 Jul 31 10:54:16 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:17 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da 1073741824" returned: 0 in 0.677s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:17 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:17 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:17 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7810f412-e1c1-4abe-83ad-c2b28e599f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5168de5-c1e9-45e6-a7c2-fa5f30ae234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:17 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Volume volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da (92c008a9-f4c6-476d-9e49-c80fa4dcb4da): created successfully Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5168de5-c1e9-45e6-a7c2-fa5f30ae234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (c0e33396-7694-4a46-8c2a-fda102bfbfb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:17 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-71e7aa6f-c825-4f41-ba09-d25779dadc91 tempest-GroupSnapshotsTest-1748992447 None] Created volume successfully. Jul 31 10:54:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] GroupSnapshot 19229afc-59ea-4a02-8f82-403ff306cc30: creating. Jul 31 10:54:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Group snapshot 19229afc-59ea-4a02-8f82-403ff306cc30: creating. {{(pid=88837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:54:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Creating offline snapshot 993d23bf-24b6-40b5-b555-6b90e0956983 of volume 92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:54:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35f3d41-4aec-4013-8021-a8529d66abdf]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:20 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:20 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:20 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.842s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:20 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 1G Jul 31 10:54:20 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Acquiring lock "cinder-4b48bd85-827c-4a92-8cd7-5e491bb50413-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Lock "cinder-4b48bd85-827c-4a92-8cd7-5e491bb50413-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Acquiring lock "cinder-quobyte-4b48bd85-827c-4a92-8cd7-5e491bb50413" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Lock "cinder-quobyte-4b48bd85-827c-4a92-8cd7-5e491bb50413" acquired by "delete_volume" :: waited 0.040s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f9341-4630-4eaf-b3d0-98a5286db232]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:21 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 Jul 31 10:54:21 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:21 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 1G" returned: 0 in 0.722s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:21 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 Jul 31 10:54:21 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:21 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413" returned: 0 in 0.774s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:22 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413 Jul 31 10:54:22 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:22 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983" returned: 0 in 0.674s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:22 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:22 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 Jul 31 10:54:22 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:22 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4b48bd85-827c-4a92-8cd7-5e491bb50413" returned: 0 in 0.732s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:22 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983" returned: 0 in 0.567s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Lock "cinder-quobyte-4b48bd85-827c-4a92-8cd7-5e491bb50413" released by "delete_volume" :: held 1.598s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:22 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info Jul 31 10:54:22 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Created reservations ['b631bc73-2318-4a54-8ec7-a07f2cfab50b', 'fe77202e-af5c-4099-bb4d-924eb02e6424', 'c2ba2d51-a347-46e1-92d3-549cd1314811', '30496b97-18b8-4fef-b8a5-9afbad5836e7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:23 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info" returned: 0 in 0.402s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:23 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:54:23 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:23 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:23 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info Jul 31 10:54:23 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:23 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.368s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Deleted volume successfully. Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a1eada5-253f-42ac-b3fe-f95f3dd5f0c4 tempest-TaggedAttachmentsTest-673862961 None] Lock "cinder-4b48bd85-827c-4a92-8cd7-5e491bb50413-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:23 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.info" returned: 0 in 0.422s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.836s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f9867d53-41ee-4f3d-97bb-fa6f1090cea5 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 19229afc-59ea-4a02-8f82-403ff306cc30: created successfully Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-993d23bf-24b6-40b5-b555-6b90e0956983-a03564a1-1bb9-4673-8587-50749430cd0b" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-993d23bf-24b6-40b5-b555-6b90e0956983-a03564a1-1bb9-4673-8587-50749430cd0b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Creating volume a03564a1-1bb9-4673-8587-50749430cd0b from snapshot 993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-a03564a1-1bb9-4673-8587-50749430cd0b" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-a03564a1-1bb9-4673-8587-50749430cd0b" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] snapshot: 993d23bf-24b6-40b5-b555-6b90e0956983, volume: a03564a1-1bb9-4673-8587-50749430cd0b, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4aae13-36d4-4bc8-b37d-6070fcf565d6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:25 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 Jul 31 10:54:25 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:26 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983" returned: 0 in 0.731s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf408994-126c-43ba-a61a-fe61bb9467f4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:26 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:26 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:26 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.518s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:54:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:26 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b Jul 31 10:54:26 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:34 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b" returned: 0 in 7.793s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:34 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cebd0f-7895-4546-914f-91eceba405f7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:34 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:34 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:35 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.668s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:54:35 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Converted 1024.00 MB image at 131.39 MB/s Jul 31 10:54:35 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:35 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b Jul 31 10:54:35 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=66,cinder:UPDATE=55,cinder:INSERT=9,cinder:DELETE=4 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=62,cinder:INSERT=12,cinder:UPDATE=43,cinder:DELETE=3 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:54:35 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b" returned: 0 in 0.259s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-a03564a1-1bb9-4673-8587-50749430cd0b" released by "_copy_volume_from_snapshot" :: held 10.132s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-993d23bf-24b6-40b5-b555-6b90e0956983-a03564a1-1bb9-4673-8587-50749430cd0b" released by "_create_volume_from_snapshot" :: held 10.183s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.208s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:35 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e810b87a-987e-47e4-b418-a9fd3f25b0dc tempest-GroupSnapshotsTest-1748992447 None] Create group from source-snapshot-19229afc-59ea-4a02-8f82-403ff306cc30 completed successfully. Jul 31 10:54:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-a03564a1-1bb9-4673-8587-50749430cd0b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-a03564a1-1bb9-4673-8587-50749430cd0b" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:37 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d26c8-5962-4144-b882-c0f0063e9c48]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:37 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b Jul 31 10:54:37 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:37 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b" returned: 0 in 0.536s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:37 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b Jul 31 10:54:37 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:38 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a03564a1-1bb9-4673-8587-50749430cd0b" returned: 0 in 0.366s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-a03564a1-1bb9-4673-8587-50749430cd0b" released by "delete_volume" :: held 0.974s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['e250bbd9-9e7c-4920-9903-83d908bdf3a9'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:38 devstack cinder-volume[88837]: WARNING cinder.quota [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-240088073 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-240088073, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:54:38 devstack cinder-volume[88837]: WARNING cinder.quota [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-240088073 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-240088073, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['d31ea6c4-4f7a-4385-9082-2bf94c1bf3df', '74ba61fb-6695-4ded-9a74-33cc687bcb89', 'edec64cb-0b2e-4e88-9628-250881cff198', '495e869b-b430-4692-97d1-83bb12eaf19f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:38 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:54:38 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:38 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.307s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:38 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:38 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6e419e5a-2e6e-4727-bb96-e131ab373353 tempest-GroupSnapshotsTest-1748992447 None] Delete group completed successfully. Jul 31 10:54:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 19229afc-59ea-4a02-8f82-403ff306cc30: deleting Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 19229afc-59ea-4a02-8f82-403ff306cc30: deleting {{(pid=88837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-993d23bf-24b6-40b5-b555-6b90e0956983" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-993d23bf-24b6-40b5-b555-6b90e0956983" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Deleting offline snapshot 993d23bf-24b6-40b5-b555-6b90e0956983 of volume 92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] snapshot_file for this snap is: volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d020acd-c0bc-40c4-a614-b0b8c05df543]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:39 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 Jul 31 10:54:39 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:40 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983" returned: 0 in 0.450s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:54:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dffa8c3-bd8f-4e3c-b31a-b61d19738680]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:40 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:40 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:40 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.360s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:40 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 Jul 31 10:54:40 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:41 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983" returned: 0 in 0.397s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:41 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983 Jul 31 10:54:41 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:41 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da.993d23bf-24b6-40b5-b555-6b90e0956983" returned: 0 in 0.276s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-993d23bf-24b6-40b5-b555-6b90e0956983" released by "_delete_snapshot" :: held 1.593s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" released by "delete_snapshot" :: held 1.618s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:41 devstack cinder-volume[88837]: WARNING cinder.quota [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-240088073 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-240088073, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:54:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['4751c2ff-7ab2-4915-9a98-925c1c5df596', '0e5dd8e0-9666-4b6a-85b7-0b577b364b4e', '841e8ad4-65d4-49e8-8221-908d940ab942', '676e9b89-4f37-426f-a0be-a6d6e941e22d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b43f43e3-7651-4bd0-b2b0-f623b87c1d9c tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 19229afc-59ea-4a02-8f82-403ff306cc30: deleted successfully Jul 31 10:54:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:54:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:54:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e538aca-2b05-4538-a1f0-e6feaea304e2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:42 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:42 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:43 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.536s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:43 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da Jul 31 10:54:43 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:43 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" returned: 0 in 0.468s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-92c008a9-f4c6-476d-9e49-c80fa4dcb4da" released by "delete_volume" :: held 1.107s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['14f0e144-b31d-4b63-b837-03b641f5efbe'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:43 devstack cinder-volume[88837]: WARNING cinder.db.api [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-240088073'] Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['05404fb9-0edb-4746-9225-021e9076cefa', 'aea30dbd-4a4f-426c-94d5-2ca0f844e490', '582cb229-5863-44f0-b83b-a5d6d3eec46a', '81127146-74f7-42a5-8929-fd763fd06247'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:43 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:54:43 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:44 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.382s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6d1ccc35-4640-4c9b-87d4-2a2a1bb6a518 tempest-GroupSnapshotsTest-1748992447 None] Delete group completed successfully. Jul 31 10:54:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7e9a54d0-4b66-49d2-b842-43e22fcb664b tempest-GroupSnapshotsTest-1748992447 None] Group tempest-GroupSnapshotsTest-Group-181174119: creating Jul 31 10:54:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7e9a54d0-4b66-49d2-b842-43e22fcb664b tempest-GroupSnapshotsTest-1748992447 None] Group tempest-GroupSnapshotsTest-Group-181174119: created successfully Jul 31 10:54:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7e9a54d0-4b66-49d2-b842-43e22fcb664b tempest-GroupSnapshotsTest-1748992447 None] Create group completed successfully. Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:46 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:54:46 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:46 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.308s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 8 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:54:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (46952cf3-c73a-4b40-81f0-9cd0d0fef641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29025c04-89ed-405b-8ea8-bf6155fbfda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29025c04-89ed-405b-8ea8-bf6155fbfda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245344737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cb28e88-c4b5-4684-a2a5-2c4e57030513,host='devstack@QuobyteHD#QuobyteHD',id=544c5967-5c5e-4b52-9f4d-988e1453d6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:47Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b8aa4e-aea7-4d3e-8943-aec53209e233),volume_type_id=e3b8aa4e-aea7-4d3e-8943-aec53209e233)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0cae72-91d7-41aa-b843-efcdb4544da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0cae72-91d7-41aa-b843-efcdb4544da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f99dc-3d24-494f-bffc-f192200f1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f99dc-3d24-494f-bffc-f192200f1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544c5967-5c5e-4b52-9f4d-988e1453d6f3', 'volume_name': 'volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41a86ef-b47f-417c-bcd6-237b0ce26e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41a86ef-b47f-417c-bcd6-237b0ce26e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32692111-03e0-49dc-bc97-cee042d7eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Volume 544c5967-5c5e-4b52-9f4d-988e1453d6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3', 'volume_size': 1} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cb28e88-c4b5-4684-a2a5-2c4e57030513,created_at=2026-07-31T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245344737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cb28e88-c4b5-4684-a2a5-2c4e57030513,host='devstack@QuobyteHD#QuobyteHD',id=544c5967-5c5e-4b52-9f4d-988e1453d6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:47Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b8aa4e-aea7-4d3e-8943-aec53209e233),volume_type_id=e3b8aa4e-aea7-4d3e-8943-aec53209e233)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Creating volume 544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:54:47 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:54:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:47 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 1073741824 Jul 31 10:54:47 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:48 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 1073741824" returned: 0 in 0.687s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:48 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 Jul 31 10:54:48 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:48 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3" returned: 0 in 0.356s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32692111-03e0-49dc-bc97-cee042d7eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e09ba5a-70d5-4e4e-b650-0d800feac65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Volume volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 (544c5967-5c5e-4b52-9f4d-988e1453d6f3): created successfully Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e09ba5a-70d5-4e4e-b650-0d800feac65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (46952cf3-c73a-4b40-81f0-9cd0d0fef641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-36d68779-7aea-4262-b4d1-6e265d238c29 tempest-GroupSnapshotsTest-1748992447 None] Created volume successfully. Jul 31 10:54:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-d0265a06-4e8d-4490-99ca-dcad2138e289 req-2c11e7ec-918e-4c40-9c4d-778b8c48ee1a tempest-AttachVolumeNegativeTest-406109207 None] Terminate volume connection completed successfully. Jul 31 10:54:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-d0265a06-4e8d-4490-99ca-dcad2138e289 req-2c11e7ec-918e-4c40-9c4d-778b8c48ee1a tempest-AttachVolumeNegativeTest-406109207 None] Deleting attachment 16a0c6f0-e73f-4d66-9046-71965343859d. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (1b453725-f57b-4354-b845-5ee0da4d7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64427d1-02ab-4775-a69f-e4f630a0c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64427d1-02ab-4775-a69f-e4f630a0c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124495266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cb28e88-c4b5-4684-a2a5-2c4e57030513,host='devstack@QuobyteHD#QuobyteHD',id=fdcebac2-1a4a-4991-bf7c-26de462105c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:51Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b8aa4e-aea7-4d3e-8943-aec53209e233),volume_type_id=e3b8aa4e-aea7-4d3e-8943-aec53209e233)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35922896-b618-4616-8735-b7bcf3517f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35922896-b618-4616-8735-b7bcf3517f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ba33b1-223c-4a0e-b65b-f47894d09d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ba33b1-223c-4a0e-b65b-f47894d09d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcebac2-1a4a-4991-bf7c-26de462105c8', 'volume_name': 'volume-fdcebac2-1a4a-4991-bf7c-26de462105c8', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b4adea-6ab7-47c2-ad65-66d7d642f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b4adea-6ab7-47c2-ad65-66d7d642f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d52cdd-df25-4019-9248-798986cbf52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:51 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Volume fdcebac2-1a4a-4991-bf7c-26de462105c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcebac2-1a4a-4991-bf7c-26de462105c8', 'volume_size': 1} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cb28e88-c4b5-4684-a2a5-2c4e57030513,created_at=2026-07-31T08:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124495266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cb28e88-c4b5-4684-a2a5-2c4e57030513,host='devstack@QuobyteHD#QuobyteHD',id=fdcebac2-1a4a-4991-bf7c-26de462105c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:54:51Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3b8aa4e-aea7-4d3e-8943-aec53209e233),volume_type_id=e3b8aa4e-aea7-4d3e-8943-aec53209e233)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Creating volume fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:54:51 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:51 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 1073741824 Jul 31 10:54:51 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:51 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 1073741824" returned: 0 in 0.671s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:52 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 Jul 31 10:54:52 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:54:52 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d52cdd-df25-4019-9248-798986cbf52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcebac2-1a4a-4991-bf7c-26de462105c8', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4550c28c-2b8f-4bc9-b79e-74d09ea715d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:54:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Volume volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 (fdcebac2-1a4a-4991-bf7c-26de462105c8): created successfully Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4550c28c-2b8f-4bc9-b79e-74d09ea715d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:54:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (1b453725-f57b-4354-b845-5ee0da4d7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:54:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-883375b2-b520-4026-b83b-6ce3ab7f845f tempest-GroupSnapshotsTest-1748992447 None] Created volume successfully. Jul 31 10:54:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-79cd1033-9c6b-4ea9-859d-236d7cbb565d tempest-GroupSnapshotsTest-1748992447 None] Update group completed successfully. Jul 31 10:54:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6f08b560-f017-4e8c-99e6-4de76a8e575a tempest-GroupSnapshotsTest-1748992447 None] Update group completed successfully. Jul 31 10:54:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d4fabb3c-72fa-4490-a43c-4c181ce4b96c tempest-GroupSnapshotsTest-1748992447 None] Update group completed successfully. Jul 31 10:54:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-55a46365-ae19-4426-9f34-7f922becf214 tempest-GroupSnapshotsTest-1748992447 None] Update group completed successfully. Jul 31 10:54:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] GroupSnapshot 8407742d-52fb-4326-b456-adbb344706bd: creating. Jul 31 10:54:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Group snapshot 8407742d-52fb-4326-b456-adbb344706bd: creating. {{(pid=88837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:54:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:54:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:54:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Creating offline snapshot 4e27c845-aee9-4b0f-acbf-d1b400f2878d of volume fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:54:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d77d20-eab8-452f-a4dc-c6699e63902a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:54:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:54:59 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 Jul 31 10:54:59 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8" returned: 0 in 0.478s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:00 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:00 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d 1G Jul 31 10:55:00 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:01 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d 1G" returned: 0 in 1.079s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:01 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d Jul 31 10:55:01 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:01 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d" returned: 0 in 0.635s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:01 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:01 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d Jul 31 10:55:01 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:02 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d" returned: 0 in 0.439s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:02 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info Jul 31 10:55:02 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:02 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info" returned: 0 in 0.463s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:02 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:02 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info Jul 31 10:55:02 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:03 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.info" returned: 0 in 0.750s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.964s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Creating offline snapshot baf7ddbf-8129-49c0-a46f-94b010c8a672 of volume 544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9adfc8e-8f4d-4ca4-8164-12ef8e00a146]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:03 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 Jul 31 10:55:03 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-950f895b-1759-416d-9ea0-6771abe88a61 req-7d4070a9-0c5c-4ed4-8393-a72930ec84ab tempest-ServerActionsTestOtherA-1867674029 None] Terminate volume connection completed successfully. Jul 31 10:55:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-950f895b-1759-416d-9ea0-6771abe88a61 req-7d4070a9-0c5c-4ed4-8393-a72930ec84ab tempest-ServerActionsTestOtherA-1867674029 None] Deleting attachment 2b860a82-4711-48fb-9840-3d713e52c2a1. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:55:04 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3" returned: 0 in 0.949s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:04 devstack sudo[93634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 1G Jul 31 10:55:04 devstack sudo[93634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:05 devstack sudo[93634]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 1G" returned: 0 in 1.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:05 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 Jul 31 10:55:05 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:06 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672" returned: 0 in 1.030s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:06 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:07 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 Jul 31 10:55:07 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:07 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672" returned: 0 in 0.600s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:07 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info Jul 31 10:55:07 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:08 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info" returned: 0 in 0.899s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:08 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:08 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info Jul 31 10:55:08 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:09 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.info" returned: 0 in 0.660s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.588s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7bc64b54-430f-4f1e-a745-81921ab2dede tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 8407742d-52fb-4326-b456-adbb344706bd: created successfully Jul 31 10:55:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 8407742d-52fb-4326-b456-adbb344706bd: deleting Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 8407742d-52fb-4326-b456-adbb344706bd: deleting {{(pid=88837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-fdcebac2-1a4a-4991-bf7c-26de462105c8" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-fdcebac2-1a4a-4991-bf7c-26de462105c8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-4e27c845-aee9-4b0f-acbf-d1b400f2878d" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-4e27c845-aee9-4b0f-acbf-d1b400f2878d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Deleting offline snapshot 4e27c845-aee9-4b0f-acbf-d1b400f2878d of volume fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] snapshot_file for this snap is: volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a413b-10ee-4a39-9321-e5449f939c0f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:10 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d Jul 31 10:55:10 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:11 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d" returned: 0 in 0.786s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdcebac2-1a4a-4991-bf7c-26de462105c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7aa56c-dd2f-4541-9ae8-fbd97eb1152c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:11 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 Jul 31 10:55:11 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:12 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8" returned: 0 in 0.820s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:12 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d Jul 31 10:55:12 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:12 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d" returned: 0 in 0.925s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:13 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d Jul 31 10:55:13 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:13 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8.4e27c845-aee9-4b0f-acbf-d1b400f2878d" returned: 0 in 0.664s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-4e27c845-aee9-4b0f-acbf-d1b400f2878d" released by "_delete_snapshot" :: held 3.450s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-fdcebac2-1a4a-4991-bf7c-26de462105c8" released by "delete_snapshot" :: held 3.507s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-544c5967-5c5e-4b52-9f4d-988e1453d6f3" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-544c5967-5c5e-4b52-9f4d-988e1453d6f3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-baf7ddbf-8129-49c0-a46f-94b010c8a672" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-baf7ddbf-8129-49c0-a46f-94b010c8a672" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Deleting offline snapshot baf7ddbf-8129-49c0-a46f-94b010c8a672 of volume 544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] snapshot_file for this snap is: volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[71763f21-e09f-4279-874a-aa397f9518e1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:14 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 Jul 31 10:55:14 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:15 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672" returned: 0 in 1.102s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daed96b-2d7a-4335-a823-4babb68e61fc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:15 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 Jul 31 10:55:15 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:15 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3" returned: 0 in 0.800s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:16 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 Jul 31 10:55:16 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:16 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672" returned: 0 in 0.993s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:16 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672 Jul 31 10:55:16 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:17 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3.baf7ddbf-8129-49c0-a46f-94b010c8a672" returned: 0 in 0.425s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-baf7ddbf-8129-49c0-a46f-94b010c8a672" released by "_delete_snapshot" :: held 3.583s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "cinder-ef386c09-45f4-471e-8b6b-fb1abb0b676f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-544c5967-5c5e-4b52-9f4d-988e1453d6f3" released by "delete_snapshot" :: held 3.641s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Lock "cinder-ef386c09-45f4-471e-8b6b-fb1abb0b676f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "cinder-quobyte-ef386c09-45f4-471e-8b6b-fb1abb0b676f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Lock "cinder-quobyte-ef386c09-45f4-471e-8b6b-fb1abb0b676f" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:17 devstack cinder-volume[88837]: WARNING cinder.quota [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1286387005 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1286387005, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:55:17 devstack cinder-volume[88837]: WARNING cinder.quota [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1286387005 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1286387005, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7d706d-f69b-41cb-9b72-01331f06a23d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['45fdf836-a65e-4fbc-a7f6-a981b99b91ff', '52ac81ad-da3e-4002-8235-ffeabe5d202e', '0b02c5be-99c8-4384-bcc3-a537de5d9f7f', '715240c9-0bb2-4417-abc9-8a1626925246'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:17 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f Jul 31 10:55:17 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:17 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['1d39fc5d-86d3-4e86-b1ca-ab620bbcda41', '5efb9bde-65e1-45b2-87fe-67f2e0121376', 'df58c7c3-5154-493a-bfc7-602addf37bf4', '5a80dd8a-17ab-4a09-99e0-648fe5e090f7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-18bac30e-96b1-478f-91e3-74f27a550c37 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot 8407742d-52fb-4326-b456-adbb344706bd: deleted successfully Jul 31 10:55:18 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f" returned: 0 in 0.688s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:18 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f Jul 31 10:55:18 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:18 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef386c09-45f4-471e-8b6b-fb1abb0b676f" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Lock "cinder-quobyte-ef386c09-45f4-471e-8b6b-fb1abb0b676f" released by "delete_volume" :: held 1.211s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:18 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Created reservations ['c6f46cb6-64ff-4806-857e-fe99ea7b1c25', '05ed0a31-6174-4a24-b5ca-b8bcde0091d6', '9736fcf9-4f1c-4359-83f6-473bb8d47cca', 'e508cec5-9558-4b05-9775-8753123e6559'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-544c5967-5c5e-4b52-9f4d-988e1453d6f3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:19 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:19 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-544c5967-5c5e-4b52-9f4d-988e1453d6f3" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165a0c9-02e0-416d-990b-e412b6dbc10c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:19 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 Jul 31 10:55:19 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:19 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.548s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Deleted volume successfully. Jul 31 10:55:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bd5a043c-3541-418e-b90b-f3b1a2fcf86d tempest-ServerActionsTestOtherA-1867674029 None] Lock "cinder-ef386c09-45f4-471e-8b6b-fb1abb0b676f-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:20 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3" returned: 0 in 0.888s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:20 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3 Jul 31 10:55:20 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:20 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-544c5967-5c5e-4b52-9f4d-988e1453d6f3" returned: 0 in 0.816s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-544c5967-5c5e-4b52-9f4d-988e1453d6f3" released by "delete_volume" :: held 1.811s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-fdcebac2-1a4a-4991-bf7c-26de462105c8" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-fdcebac2-1a4a-4991-bf7c-26de462105c8" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c933f4-fc31-4323-a486-d971e0db8c91]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:21 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 Jul 31 10:55:21 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:21 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8" returned: 0 in 0.539s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:21 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8 Jul 31 10:55:21 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:22 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-fdcebac2-1a4a-4991-bf7c-26de462105c8" returned: 0 in 1.020s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-fdcebac2-1a4a-4991-bf7c-26de462105c8" released by "delete_volume" :: held 1.659s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['6d9ee5b1-12da-43a4-93bc-1ed9cbe832a6'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:22 devstack cinder-volume[88837]: WARNING cinder.quota [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1286387005 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1286387005, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:55:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['42f15cef-f9d9-455f-837a-f18626388955', 'd8e9b964-9aa1-479f-b7b9-2659e648ae71', '53133e97-9cc2-4fe2-a164-8b6923e711c8', '110c319c-f9a3-4fdd-8c6c-f3cf12b92e12'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['1af1dfab-32cc-41cd-847b-cdc608232de3', 'bf729152-f2df-4600-9648-de998e4dcca3', 'a59aac8a-ead2-467d-9f6e-e3beba7c0cb0', '40817a9f-5741-495f-a17b-6c8bf7d94118'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:23 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:23 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:23 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.503s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:23 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-dabb868d-c00c-421b-84e2-5fc2f01165aa tempest-GroupSnapshotsTest-1748992447 None] Delete group completed successfully. Jul 31 10:55:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-778c65a9-6997-462d-9a0c-a421434f8d0f tempest-GroupSnapshotsTest-1748992447 None] Group tempest-GroupSnapshotsTest-Group-1912267403: creating Jul 31 10:55:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-778c65a9-6997-462d-9a0c-a421434f8d0f tempest-GroupSnapshotsTest-1748992447 None] Group tempest-GroupSnapshotsTest-Group-1912267403: created successfully Jul 31 10:55:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-778c65a9-6997-462d-9a0c-a421434f8d0f tempest-GroupSnapshotsTest-1748992447 None] Create group completed successfully. Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Flow 'volume_create_manager' (140f8b68-435c-4f5e-8561-c7548cd7c720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec88bba-3996-4fe3-ac45-172584a84e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec88bba-3996-4fe3-ac45-172584a84e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-462058020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3146904a-14aa-4473-86ea-9cca5a193f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91a32778ce1479c9926df93bfbe79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:26Z,use_quota=True,user_id='ef5884f80b4747f5be8bfd7fd1845264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf014e5-b420-426d-afb0-5ef2a68d58f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf014e5-b420-426d-afb0-5ef2a68d58f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab82d4df-070c-4a9c-86fa-4ad0ac5d2ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab82d4df-070c-4a9c-86fa-4ad0ac5d2ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3146904a-14aa-4473-86ea-9cca5a193f6f', 'volume_name': 'volume-3146904a-14aa-4473-86ea-9cca5a193f6f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f32c12-eb47-4ca7-82a7-337e68a030a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f32c12-eb47-4ca7-82a7-337e68a030a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc602d21-2483-4864-b1f9-55724785fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Volume 3146904a-14aa-4473-86ea-9cca5a193f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3146904a-14aa-4473-86ea-9cca5a193f6f', 'volume_size': 1} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-462058020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3146904a-14aa-4473-86ea-9cca5a193f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c91a32778ce1479c9926df93bfbe79cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:26Z,use_quota=True,user_id='ef5884f80b4747f5be8bfd7fd1845264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Creating volume 3146904a-14aa-4473-86ea-9cca5a193f6f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:26 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:27 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f 1073741824 Jul 31 10:55:27 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (fde8e742-1c4f-48af-81f6-daf7e908e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4714e59b-0b23-4c42-88fa-7f1d1ea3d657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4714e59b-0b23-4c42-88fa-7f1d1ea3d657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862595009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9698df53-e95b-4158-b583-1b8d9e2d198a,host='devstack@QuobyteHD#QuobyteHD',id=1c8eb620-4aa4-484c-a430-b09661c746be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:27Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a73707c-1559-4dad-b69d-6123b7a0b039),volume_type_id=7a73707c-1559-4dad-b69d-6123b7a0b039)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479eeee7-a12b-4c4b-a88d-e8b9e69bb983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479eeee7-a12b-4c4b-a88d-e8b9e69bb983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ffcc75-2d92-4248-b812-5b7dd18d7424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ffcc75-2d92-4248-b812-5b7dd18d7424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8eb620-4aa4-484c-a430-b09661c746be', 'volume_name': 'volume-1c8eb620-4aa4-484c-a430-b09661c746be', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f36bb1-3ba5-4ddd-a7c6-ff0b5b8ca4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f36bb1-3ba5-4ddd-a7c6-ff0b5b8ca4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050d874b-d924-408c-a2c3-f07163c7d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:27 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Volume 1c8eb620-4aa4-484c-a430-b09661c746be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8eb620-4aa4-484c-a430-b09661c746be', 'volume_size': 1} Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:27 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f 1073741824" returned: 0 in 0.984s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:28 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f Jul 31 10:55:28 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:28 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f" returned: 0 in 0.636s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9698df53-e95b-4158-b583-1b8d9e2d198a,created_at=2026-07-31T08:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862595009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9698df53-e95b-4158-b583-1b8d9e2d198a,host='devstack@QuobyteHD#QuobyteHD',id=1c8eb620-4aa4-484c-a430-b09661c746be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201a3249771248b5bbd49c3bd228fd96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:27Z,use_quota=True,user_id='a3de8094c459429095c00c008ded4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a73707c-1559-4dad-b69d-6123b7a0b039),volume_type_id=7a73707c-1559-4dad-b69d-6123b7a0b039)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Creating volume 1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:28 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:28 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be 1073741824 Jul 31 10:55:28 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc602d21-2483-4864-b1f9-55724785fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3146904a-14aa-4473-86ea-9cca5a193f6f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24a9a87-10ac-4177-8225-841f6eb1b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Volume volume-3146904a-14aa-4473-86ea-9cca5a193f6f (3146904a-14aa-4473-86ea-9cca5a193f6f): created successfully Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24a9a87-10ac-4177-8225-841f6eb1b362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Flow 'volume_create_manager' (140f8b68-435c-4f5e-8561-c7548cd7c720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3abf132b-6468-4842-99dc-e26701cc3891 tempest-ServerRescueNegativeTestJSON-1571258585 None] Created volume successfully. Jul 31 10:55:29 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be 1073741824" returned: 0 in 1.030s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:29 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be Jul 31 10:55:29 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:30 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be" returned: 0 in 0.531s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050d874b-d924-408c-a2c3-f07163c7d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8eb620-4aa4-484c-a430-b09661c746be', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5767ee1-dd8d-450b-bc44-9323654947f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:30 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Volume volume-1c8eb620-4aa4-484c-a430-b09661c746be (1c8eb620-4aa4-484c-a430-b09661c746be): created successfully Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5767ee1-dd8d-450b-bc44-9323654947f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Flow 'volume_create_manager' (fde8e742-1c4f-48af-81f6-daf7e908e32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-938822e9-7e6b-494c-91ea-8fb6ba8d5036 tempest-GroupSnapshotsTest-1748992447 None] Created volume successfully. Jul 31 10:55:31 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] GroupSnapshot c7622152-0ebf-44bc-9feb-297d56c733a8: creating. Jul 31 10:55:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Group snapshot c7622152-0ebf-44bc-9feb-297d56c733a8: creating. {{(pid=88837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:55:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Creating offline snapshot e3172e33-c3e0-453b-ba11-d218f34d3b5a of volume 1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:31 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad42b43-580f-4797-8ea3-f002e02281a4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:31 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be Jul 31 10:55:31 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:32 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be" returned: 0 in 0.726s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:32 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a 1G Jul 31 10:55:32 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:33 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a 1G" returned: 0 in 1.212s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8eb620-4aa4-484c-a430-b09661c746be -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:33 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8eb620-4aa4-484c-a430-b09661c746be -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a Jul 31 10:55:33 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:34 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c8eb620-4aa4-484c-a430-b09661c746be -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a" returned: 0 in 0.669s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:34 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:34 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a Jul 31 10:55:34 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:34 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:34 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info Jul 31 10:55:34 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:35 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info" returned: 0 in 0.835s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:35 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:35 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info Jul 31 10:55:35 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:36 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.info" returned: 0 in 0.566s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.656s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:36 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=85,cinder:UPDATE=92,cinder:INSERT=22,cinder:DELETE=3 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:36 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=89,cinder:SELECT=92,cinder:INSERT=20,cinder:DELETE=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:55:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b8498224-aeaa-45cf-b1d5-2c174e7e77d6 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot c7622152-0ebf-44bc-9feb-297d56c733a8: created successfully Jul 31 10:55:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot c7622152-0ebf-44bc-9feb-297d56c733a8: deleting Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot c7622152-0ebf-44bc-9feb-297d56c733a8: deleting {{(pid=88837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-1c8eb620-4aa4-484c-a430-b09661c746be" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-1c8eb620-4aa4-484c-a430-b09661c746be" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-e3172e33-c3e0-453b-ba11-d218f34d3b5a" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-e3172e33-c3e0-453b-ba11-d218f34d3b5a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Deleting offline snapshot e3172e33-c3e0-453b-ba11-d218f34d3b5a of volume 1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] snapshot_file for this snap is: volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[083965fd-fd0e-46f8-a6cc-b139271bfa40]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:37 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a Jul 31 10:55:37 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:38 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a" returned: 0 in 0.678s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c8eb620-4aa4-484c-a430-b09661c746be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:55:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e099d-9091-4bab-9337-ced7522d42ab]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be Jul 31 10:55:38 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:38 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be" returned: 0 in 0.576s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:38 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a Jul 31 10:55:38 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:39 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:39 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a Jul 31 10:55:39 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:39 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be.e3172e33-c3e0-453b-ba11-d218f34d3b5a" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-e3172e33-c3e0-453b-ba11-d218f34d3b5a" released by "_delete_snapshot" :: held 2.162s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-1c8eb620-4aa4-484c-a430-b09661c746be" released by "delete_snapshot" :: held 2.211s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:39 devstack cinder-volume[88837]: WARNING cinder.quota [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1119806404 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1119806404, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:55:39 devstack cinder-volume[88837]: WARNING cinder.quota [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1119806404 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1119806404, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:55:39 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['ef3c72be-11c9-48ef-8a7d-6fb0b3abb623', 'e30061c9-2b67-46de-bfcb-cabe698e4815', 'b1737943-da9c-4187-a97d-c1866cf90565', '28690d7e-f872-4d98-ae51-3c12ef1f9c12'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-88e6d95c-477b-4027-9f20-3b90119d8467 tempest-GroupSnapshotsTest-1748992447 None] group_snapshot c7622152-0ebf-44bc-9feb-297d56c733a8: deleted successfully Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Flow 'volume_create_manager' (1a5f2fc0-0971-4b3b-83d6-7917824c0151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b10c805-f400-463a-a9db-6454ee2fd1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b10c805-f400-463a-a9db-6454ee2fd1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1272681491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e88459e-50b0-439b-aa67-488aab034a5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea8ed40da884284a60a8321edaa91a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:40Z,use_quota=True,user_id='4b648f65d4a54439a623f817d7eb1220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887343f0-1090-4969-8cd2-4f065fe415f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887343f0-1090-4969-8cd2-4f065fe415f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4646d8-a70f-481b-b132-21f1e9daa2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4646d8-a70f-481b-b132-21f1e9daa2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e88459e-50b0-439b-aa67-488aab034a5f', 'volume_name': 'volume-7e88459e-50b0-439b-aa67-488aab034a5f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f6098d-127f-4843-b46f-56f32789e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f6098d-127f-4843-b46f-56f32789e857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29f91ef-2a1c-478e-85a3-b2eecb8c7b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Volume 7e88459e-50b0-439b-aa67-488aab034a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e88459e-50b0-439b-aa67-488aab034a5f', 'volume_size': 1} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1272681491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e88459e-50b0-439b-aa67-488aab034a5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea8ed40da884284a60a8321edaa91a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:40Z,use_quota=True,user_id='4b648f65d4a54439a623f817d7eb1220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Creating volume 7e88459e-50b0-439b-aa67-488aab034a5f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:40 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:40 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f 1073741824 Jul 31 10:55:40 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:41 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f 1073741824" returned: 0 in 0.541s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f Jul 31 10:55:41 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "cinder-quobyte-1c8eb620-4aa4-484c-a430-b09661c746be" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:41 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f" returned: 0 in 0.386s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-1c8eb620-4aa4-484c-a430-b09661c746be" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29f91ef-2a1c-478e-85a3-b2eecb8c7b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e88459e-50b0-439b-aa67-488aab034a5f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac11754-3b96-4748-b872-c00ecf217ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a52d2c1-07d4-4cee-a0fe-693537574d1d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Volume volume-7e88459e-50b0-439b-aa67-488aab034a5f (7e88459e-50b0-439b-aa67-488aab034a5f): created successfully Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac11754-3b96-4748-b872-c00ecf217ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Flow 'volume_create_manager' (1a5f2fc0-0971-4b3b-83d6-7917824c0151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e2df2807-2c36-47f9-9c6f-83f3265eb869 tempest-VolumesTestJSON-781558437 None] Created volume successfully. Jul 31 10:55:41 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be Jul 31 10:55:41 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:41 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:41 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be Jul 31 10:55:41 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:42 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1c8eb620-4aa4-484c-a430-b09661c746be" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Lock "cinder-quobyte-1c8eb620-4aa4-484c-a430-b09661c746be" released by "delete_volume" :: held 0.802s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Acquiring lock "cinder-3146904a-14aa-4473-86ea-9cca5a193f6f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "cinder-3146904a-14aa-4473-86ea-9cca5a193f6f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['24287fb0-8a3c-42c4-8859-41fd2cef0827'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Acquiring lock "cinder-quobyte-3146904a-14aa-4473-86ea-9cca5a193f6f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "cinder-quobyte-3146904a-14aa-4473-86ea-9cca5a193f6f" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:42 devstack cinder-volume[88837]: WARNING cinder.quota [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1119806404 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1119806404, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4911d9-6dec-424a-b47a-010201a96976]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Created reservations ['c6bc89da-3a07-4082-899e-64ee28cc8b25', '3063b35f-7ade-423f-8dea-7494a4f2116c', 'd76c1d1b-30d7-4961-9af7-d8dc6780340e', '150d8b25-0cc2-4a37-9fc1-4f0297292505'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:42 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f Jul 31 10:55:42 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:42 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:42 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:43 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.574s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ee3ea885-0447-40c7-8e51-14575d3a8f90 tempest-GroupSnapshotsTest-1748992447 None] Delete group completed successfully. Jul 31 10:55:43 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f" returned: 0 in 0.853s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:43 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f Jul 31 10:55:43 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Flow 'volume_create_manager' (179d3448-23c7-4fd5-bda1-a1a741d81843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14afbbd-d9fc-49d5-8325-20a77bb3ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14afbbd-d9fc-49d5-8325-20a77bb3ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-87783519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea8ed40da884284a60a8321edaa91a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:43Z,use_quota=True,user_id='4b648f65d4a54439a623f817d7eb1220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3605d83f-75cc-4086-8494-c885c806e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3605d83f-75cc-4086-8494-c885c806e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24506b3-bdfd-4e1d-8691-04254c264a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24506b3-bdfd-4e1d-8691-04254c264a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd', 'volume_name': 'volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13cb219-52e0-485e-ae93-f70d20540f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d13cb219-52e0-485e-ae93-f70d20540f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546566fb-abfc-4ddb-862a-04835c80a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:43 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Volume 9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd', 'volume_size': 1} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-87783519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea8ed40da884284a60a8321edaa91a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:43Z,use_quota=True,user_id='4b648f65d4a54439a623f817d7eb1220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Creating volume 9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:43 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:43 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3146904a-14aa-4473-86ea-9cca5a193f6f" returned: 0 in 0.488s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:43 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd 1073741824 Jul 31 10:55:43 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "cinder-quobyte-3146904a-14aa-4473-86ea-9cca5a193f6f" released by "delete_volume" :: held 1.416s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Created reservations ['eeaad45a-2871-45cb-8dc2-53b4a772d2f5', '4936b271-7be2-48e7-8434-eee0f495fd76', '12998ac1-d080-4be6-b5f5-9553e40552cf', '310177ed-0b47-46e6-b232-3eab9002e5c9'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:44 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:44 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:44 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.326s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Deleted volume successfully. Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca58fe81-4441-43a3-b068-d8c23abad13e tempest-ServerRescueNegativeTestJSON-1571258585 None] Lock "cinder-3146904a-14aa-4473-86ea-9cca5a193f6f-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:44 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd 1073741824" returned: 0 in 1.063s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:45 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd Jul 31 10:55:45 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:45 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd" returned: 0 in 0.666s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546566fb-abfc-4ddb-862a-04835c80a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74bf8b2-f4a4-4640-8e9f-001f8b9da454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:45 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Volume volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd (9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd): created successfully Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74bf8b2-f4a4-4640-8e9f-001f8b9da454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Flow 'volume_create_manager' (179d3448-23c7-4fd5-bda1-a1a741d81843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3a9ff899-014d-4f4b-a466-fbfdd83ea81c tempest-VolumesTestJSON-781558437 None] Created volume successfully. Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:46 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:46 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:46 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Flow 'volume_create_manager' (e6081db3-f76d-4f0a-a730-a7af22bf19c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0432bd-a08b-4e05-88a0-d89e9f6837d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0432bd-a08b-4e05-88a0-d89e9f6837d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-16969777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a9a9a6-dee6-456a-8780-4237d7f4991a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc4f114227d4fd09efaf80bcc758a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:47Z,use_quota=True,user_id='e78313ab0cf84f3db51f866f43df88e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc34c5c-6ac1-4a70-9af1-c5050161f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:47 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc34c5c-6ac1-4a70-9af1-c5050161f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738fd333-8d8d-4be6-bdb2-c849f8226d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738fd333-8d8d-4be6-bdb2-c849f8226d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a9a9a6-dee6-456a-8780-4237d7f4991a', 'volume_name': 'volume-32a9a9a6-dee6-456a-8780-4237d7f4991a', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1627b1-725d-4d5b-923a-d3913ee58a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1627b1-725d-4d5b-923a-d3913ee58a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2316832c-25a5-4005-813a-c612316159e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Volume 32a9a9a6-dee6-456a-8780-4237d7f4991a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a9a9a6-dee6-456a-8780-4237d7f4991a', 'volume_size': 1} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-16969777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a9a9a6-dee6-456a-8780-4237d7f4991a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc4f114227d4fd09efaf80bcc758a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:47Z,use_quota=True,user_id='e78313ab0cf84f3db51f866f43df88e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Creating volume 32a9a9a6-dee6-456a-8780-4237d7f4991a {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:47 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.763s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 8 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:55:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:55:47 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a 1073741824 Jul 31 10:55:47 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Flow 'volume_create_manager' (279d230f-7db4-416f-8a96-ebba2227f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cf439f-dc69-477f-8ad3-1df6cb905b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:48 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87cf439f-dc69-477f-8ad3-1df6cb905b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1708899446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea8ed40da884284a60a8321edaa91a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:48Z,use_quota=True,user_id='4b648f65d4a54439a623f817d7eb1220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0df6603-90de-4f7b-8200-b30e87b6d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0df6603-90de-4f7b-8200-b30e87b6d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e9eeee-48ef-4801-83b8-a62a96a12a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e9eeee-48ef-4801-83b8-a62a96a12a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e', 'volume_name': 'volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450da9c3-062f-443e-b05f-5b68159bb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450da9c3-062f-443e-b05f-5b68159bb173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eca0f13-09c4-4c23-9cee-59fd81945c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Volume 2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e', 'volume_size': 1} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a 1073741824" returned: 0 in 1.025s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:48 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a Jul 31 10:55:48 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a" returned: 0 in 0.411s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.468s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1708899446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cea8ed40da884284a60a8321edaa91a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:48Z,use_quota=True,user_id='4b648f65d4a54439a623f817d7eb1220',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Creating volume 2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:48 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:48 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e 1073741824 Jul 31 10:55:48 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2316832c-25a5-4005-813a-c612316159e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a9a9a6-dee6-456a-8780-4237d7f4991a', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b364864-a30d-49b5-9d57-95da39b10a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Volume volume-32a9a9a6-dee6-456a-8780-4237d7f4991a (32a9a9a6-dee6-456a-8780-4237d7f4991a): created successfully Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b364864-a30d-49b5-9d57-95da39b10a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Flow 'volume_create_manager' (e6081db3-f76d-4f0a-a730-a7af22bf19c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bfb53a1d-6538-4d3e-8efd-c762d9e2091e tempest-AttachVolumeNegativeTest-406109207 None] Created volume successfully. Jul 31 10:55:49 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e 1073741824" returned: 0 in 0.706s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:49 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e Jul 31 10:55:49 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:49 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eca0f13-09c4-4c23-9cee-59fd81945c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f679995-0434-405e-89ca-3e8bd184fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:49 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Volume volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e (2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e): created successfully Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f679995-0434-405e-89ca-3e8bd184fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Flow 'volume_create_manager' (279d230f-7db4-416f-8a96-ebba2227f671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fedcd95c-fe73-404f-8b34-b0d69421886b tempest-VolumesTestJSON-781558437 None] Created volume successfully. Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c449c7b5-f284-40b5-aace-0df382a17679]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:51 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a Jul 31 10:55:51 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:51 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.472s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-32a9a9a6-dee6-456a-8780-4237d7f4991a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b14da79-a55d-4725-8d4e-2b69e68595fa', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:55:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-2a6a5070-ea7d-4be0-9a29-0b5447871968 req-369ff278-0786-43f8-8399-d8011a9acbd3 tempest-AttachVolumeNegativeTest-406109207 None] attachment_update completed successfully. Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Acquiring lock "cinder-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Lock "cinder-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Acquiring lock "cinder-quobyte-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Lock "cinder-quobyte-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9e829f-5c93-401f-8ab2-dcb3d72106f1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:52 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e Jul 31 10:55:52 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1113283d-3791-4de2-824e-084483de9373 tempest-GroupSnapshotsV319Test-799298501 None] Group tempest-GroupSnapshotsV319Test-Group-594386205: creating Jul 31 10:55:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1113283d-3791-4de2-824e-084483de9373 tempest-GroupSnapshotsV319Test-799298501 None] Group tempest-GroupSnapshotsV319Test-Group-594386205: created successfully Jul 31 10:55:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1113283d-3791-4de2-824e-084483de9373 tempest-GroupSnapshotsV319Test-799298501 None] Create group completed successfully. Jul 31 10:55:52 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e" returned: 0 in 0.560s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:52 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e Jul 31 10:55:52 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:53 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Lock "cinder-quobyte-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e" released by "delete_volume" :: held 0.979s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Created reservations ['d012eeb1-6025-45e8-9c23-900c0a9b05c3', '7895b43f-0907-47fe-b7bc-2df486c2217f', '515235ca-66f9-42ac-b514-c6906da82023', '3b577259-d98d-432e-824b-e81268dbf60f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:53 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:53 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:53 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.325s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Deleted volume successfully. Jul 31 10:55:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-03615e24-94a1-4657-97f4-1229aa73ee74 tempest-VolumesTestJSON-781558437 None] Lock "cinder-2bc4408e-e6e8-4ab2-b76e-c4feb0540a4e-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Acquiring lock "cinder-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Lock "cinder-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Flow 'volume_create_manager' (05441419-4eed-4975-b28f-242d10e1b94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08494d-0041-47c7-af27-bf652056b4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08494d-0041-47c7-af27-bf652056b4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73895794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62e8d097-b2b6-4f79-a75b-04f758090a40,host='devstack@QuobyteHD#QuobyteHD',id=33258677-b698-4101-99b0-280433b054e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687dd1e2307b474fb59c0fdfe5027b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:54Z,use_quota=True,user_id='dc492cece9cd4ee8bd47933e1e40bc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9402a6-656f-421a-a4d8-8dabbab2559c),volume_type_id=3b9402a6-656f-421a-a4d8-8dabbab2559c)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa28e2-3ef5-439b-ab1c-83db2187c41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa28e2-3ef5-439b-ab1c-83db2187c41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b329c5b0-8d95-499a-9ba4-2d67b88bea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b329c5b0-8d95-499a-9ba4-2d67b88bea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33258677-b698-4101-99b0-280433b054e3', 'volume_name': 'volume-33258677-b698-4101-99b0-280433b054e3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8908d49e-08f9-4e43-87ad-b60e7ae74b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8908d49e-08f9-4e43-87ad-b60e7ae74b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26489b6-79a1-4917-9b7f-d89117e14821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Volume 33258677-b698-4101-99b0-280433b054e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33258677-b698-4101-99b0-280433b054e3', 'volume_size': 1} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62e8d097-b2b6-4f79-a75b-04f758090a40,created_at=2026-07-31T08:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-73895794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62e8d097-b2b6-4f79-a75b-04f758090a40,host='devstack@QuobyteHD#QuobyteHD',id=33258677-b698-4101-99b0-280433b054e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687dd1e2307b474fb59c0fdfe5027b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:55:54Z,use_quota=True,user_id='dc492cece9cd4ee8bd47933e1e40bc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9402a6-656f-421a-a4d8-8dabbab2559c),volume_type_id=3b9402a6-656f-421a-a4d8-8dabbab2559c)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Creating volume 33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:55:54 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:54 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 1073741824 Jul 31 10:55:54 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Acquiring lock "cinder-quobyte-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-eeaeb41e-70f9-4e8b-a633-a3dab7787811 req-9e6c2c5f-08f7-401d-8382-d4afaa1a4e50 tempest-AttachVolumeNegativeTest-406109207 None] Terminate volume connection completed successfully. Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-eeaeb41e-70f9-4e8b-a633-a3dab7787811 req-9e6c2c5f-08f7-401d-8382-d4afaa1a4e50 tempest-AttachVolumeNegativeTest-406109207 None] Deleting attachment 7b14da79-a55d-4725-8d4e-2b69e68595fa. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Lock "cinder-quobyte-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf5bb8-4d59-4d97-962f-ec5c6da35955]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:54 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd Jul 31 10:55:54 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:55 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 1073741824" returned: 0 in 0.551s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:55 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd Jul 31 10:55:55 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:55 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 Jul 31 10:55:55 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:55 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd" returned: 0 in 0.494s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3" returned: 0 in 0.503s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Lock "cinder-quobyte-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd" released by "delete_volume" :: held 1.057s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26489b6-79a1-4917-9b7f-d89117e14821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33258677-b698-4101-99b0-280433b054e3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88af73c9-f344-47b1-87ed-badae30ea7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:55:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Volume volume-33258677-b698-4101-99b0-280433b054e3 (33258677-b698-4101-99b0-280433b054e3): created successfully Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88af73c9-f344-47b1-87ed-badae30ea7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Flow 'volume_create_manager' (05441419-4eed-4975-b28f-242d10e1b94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:55:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9ba051ec-fe80-4227-951a-8cfdf862391a tempest-GroupSnapshotsV319Test-799298501 None] Created volume successfully. Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Created reservations ['573fc41d-3675-4d6d-ba18-01acdc264cf5', 'd3cfe276-e386-4770-9809-3bb83c5bd57c', '0ef69342-fa31-4a6b-9377-62a02ca9723b', 'b3d4e708-9807-4514-9d4c-955f7055ed3c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:55 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:55 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:56 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.347s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Deleted volume successfully. Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7297fa5f-2897-4f54-937e-77ebdccae448 tempest-VolumesTestJSON-781558437 None] Lock "cinder-9f069aa3-fdc5-49eb-9d1a-ab8ce91479fd-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Acquiring lock "cinder-7e88459e-50b0-439b-aa67-488aab034a5f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Lock "cinder-7e88459e-50b0-439b-aa67-488aab034a5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Acquiring lock "cinder-quobyte-7e88459e-50b0-439b-aa67-488aab034a5f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Lock "cinder-quobyte-7e88459e-50b0-439b-aa67-488aab034a5f" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c51d54-d143-4e65-b20a-4f4395488405]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:56 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f Jul 31 10:55:56 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] GroupSnapshot 37d35670-ee0f-4074-86d4-0383a77f2501: creating. Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Group snapshot 37d35670-ee0f-4074-86d4-0383a77f2501: creating. {{(pid=88837) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Creating offline snapshot 130792b2-7696-4e0d-83ec-43b4bb8ad47b of volume 33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca7c9b-a6bc-4a2b-bf79-c7a81a6e7108]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:57 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f" returned: 0 in 0.665s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:57 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f Jul 31 10:55:57 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:57 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 Jul 31 10:55:57 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:57 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7e88459e-50b0-439b-aa67-488aab034a5f" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Lock "cinder-quobyte-7e88459e-50b0-439b-aa67-488aab034a5f" released by "delete_volume" :: held 1.054s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Created reservations ['36e97bdd-1533-45b6-b6e4-544c5c0d9caa', '77120bd2-865d-4e0d-af90-4921449311aa', 'f9964937-974e-46ca-99d0-43862795f1d9', 'fbf4ca5e-20ef-43e3-b856-3985cc5e55e5'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:55:57 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:58 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b 1G Jul 31 10:55:58 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:58 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:55:58 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.320s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:55:58 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Deleted volume successfully. Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-89e84c9f-bbc0-4799-bd0d-5451001734c2 tempest-VolumesTestJSON-781558437 None] Lock "cinder-7e88459e-50b0-439b-aa67-488aab034a5f-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:55:58 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b 1G" returned: 0 in 0.609s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33258677-b698-4101-99b0-280433b054e3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:58 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33258677-b698-4101-99b0-280433b054e3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b Jul 31 10:55:58 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:58 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33258677-b698-4101-99b0-280433b054e3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:58 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:58 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b Jul 31 10:55:58 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:59 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b" returned: 0 in 0.343s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:59 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info Jul 31 10:55:59 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:55:59 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 31 10:55:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info" returned: 0 in 0.351s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:55:59 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:55:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:55:59 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info Jul 31 10:55:59 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:00 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.info" returned: 0 in 0.334s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3ee12905-4d5d-4817-965a-a83f5344b524 tempest-GroupSnapshotsV319Test-799298501 None] group_snapshot 37d35670-ee0f-4074-86d4-0383a77f2501: created successfully Jul 31 10:56:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] group_snapshot 37d35670-ee0f-4074-86d4-0383a77f2501: deleting Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] group_snapshot 37d35670-ee0f-4074-86d4-0383a77f2501: deleting {{(pid=88837) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "cinder-quobyte-33258677-b698-4101-99b0-280433b054e3" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Lock "cinder-quobyte-33258677-b698-4101-99b0-280433b054e3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "cinder-quobyte-130792b2-7696-4e0d-83ec-43b4bb8ad47b" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Lock "cinder-quobyte-130792b2-7696-4e0d-83ec-43b4bb8ad47b" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Deleting offline snapshot 130792b2-7696-4e0d-83ec-43b4bb8ad47b of volume 33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] snapshot_file for this snap is: volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1855d-9c17-44f1-b43e-61f8ee9225bf]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:01 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b Jul 31 10:56:01 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:01 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b" returned: 0 in 0.440s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33258677-b698-4101-99b0-280433b054e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b978a-dbd3-409b-b782-31e3edfa5524]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:02 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 Jul 31 10:56:02 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:02 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3" returned: 0 in 0.495s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:02 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b Jul 31 10:56:02 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:02 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b" returned: 0 in 0.564s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:03 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b Jul 31 10:56:03 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:03 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3.130792b2-7696-4e0d-83ec-43b4bb8ad47b" returned: 0 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Lock "cinder-quobyte-130792b2-7696-4e0d-83ec-43b4bb8ad47b" released by "_delete_snapshot" :: held 2.103s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Lock "cinder-quobyte-33258677-b698-4101-99b0-280433b054e3" released by "delete_snapshot" :: held 2.155s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:03 devstack cinder-volume[88837]: WARNING cinder.quota [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1448448904 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1448448904, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:03 devstack cinder-volume[88837]: WARNING cinder.quota [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1448448904 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1448448904, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] Created reservations ['0bcad997-4f43-41d3-9a85-d37e68a31a7b', 'ca76d07a-5551-4746-bf45-6d34e0a5157a', 'ab14e47b-6aa2-4c02-b9cd-674c35ce0e2e', 'c65be653-24d2-47e3-8ed6-822b316ca7cd'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d7adb1db-ff5b-4c03-b384-781de243a122 tempest-GroupSnapshotsV319Test-799298501 None] group_snapshot 37d35670-ee0f-4074-86d4-0383a77f2501: deleted successfully Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "cinder-quobyte-33258677-b698-4101-99b0-280433b054e3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Lock "cinder-quobyte-33258677-b698-4101-99b0-280433b054e3" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2876e2fb-c9a6-42c3-9992-4524105e9119]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:05 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 Jul 31 10:56:05 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:05 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3" returned: 0 in 0.457s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:05 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3 Jul 31 10:56:05 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:05 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-33258677-b698-4101-99b0-280433b054e3" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Lock "cinder-quobyte-33258677-b698-4101-99b0-280433b054e3" released by "delete_volume" :: held 0.851s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Created reservations ['03ada560-bc4c-418d-9cc9-24159ab6a93e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:06 devstack cinder-volume[88837]: WARNING cinder.quota [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1448448904 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1448448904, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Created reservations ['b7d62dd0-b88d-42f1-8899-0d08d4dffe9b', '3f76643f-ad41-448c-a7d4-370639955e77', '510f2a91-fd66-4bc4-a9ae-db8e2e4de6a3', 'fc4b314b-8876-408f-be33-a5b58c2eb1a1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:06 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:06 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:06 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:06 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2dec48ff-5c37-4632-a960-bc4093ed4855 tempest-GroupSnapshotsV319Test-799298501 None] Delete group completed successfully. Jul 31 10:56:16 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=77,cinder:UPDATE=86,cinder:INSERT=23,cinder:DELETE=5 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:56:16 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=76,cinder:UPDATE=87,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:56:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3d93996e-09f0-441a-9a78-374d08867925 tempest-GroupsTest-2075610648 None] Group tempest-Group1-369134643: creating Jul 31 10:56:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3d93996e-09f0-441a-9a78-374d08867925 tempest-GroupsTest-2075610648 None] Group tempest-Group1-369134643: created successfully Jul 31 10:56:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3d93996e-09f0-441a-9a78-374d08867925 tempest-GroupsTest-2075610648 None] Create group completed successfully. Jul 31 10:56:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9c2628ad-5e42-4336-ba53-1b65ab369b04 tempest-GroupsTest-2075610648 None] Group tempest-Group2-269322983: creating Jul 31 10:56:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9c2628ad-5e42-4336-ba53-1b65ab369b04 tempest-GroupsTest-2075610648 None] Group tempest-Group2-269322983: created successfully Jul 31 10:56:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9c2628ad-5e42-4336-ba53-1b65ab369b04 tempest-GroupsTest-2075610648 None] Create group completed successfully. Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Flow 'volume_create_manager' (3e498b1b-cf1a-42fd-aa8e-0a97cec715ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da0cde8-dc0c-41d2-9dc5-eb3e7ea208c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da0cde8-dc0c-41d2-9dc5-eb3e7ea208c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-196130401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5daa1448-8a6b-4be4-94c3-8060d1b6a27c,host='devstack@QuobyteHD#QuobyteHD',id=56bb91fa-7ab7-4b26-9be2-40cfd3094c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dfd4e070a4eaf8e47df1fa88146b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:22Z,use_quota=True,user_id='d4af1711846a407c8d9739acacbb6358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07e8459b-a09a-44c3-9ca8-20a836b68eba),volume_type_id=07e8459b-a09a-44c3-9ca8-20a836b68eba)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ef38a9-b0df-4d58-9a16-6b54a950371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ef38a9-b0df-4d58-9a16-6b54a950371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6185ebd5-7531-4eba-ac84-8f6cd2d758a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6185ebd5-7531-4eba-ac84-8f6cd2d758a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bb91fa-7ab7-4b26-9be2-40cfd3094c69', 'volume_name': 'volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33441d99-6baa-450e-a274-591788ccb594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33441d99-6baa-450e-a274-591788ccb594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4e402d-058b-4c8e-9fbd-22994534f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:22 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Volume 56bb91fa-7ab7-4b26-9be2-40cfd3094c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69', 'volume_size': 1} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5daa1448-8a6b-4be4-94c3-8060d1b6a27c,created_at=2026-07-31T08:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-196130401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5daa1448-8a6b-4be4-94c3-8060d1b6a27c,host='devstack@QuobyteHD#QuobyteHD',id=56bb91fa-7ab7-4b26-9be2-40cfd3094c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dfd4e070a4eaf8e47df1fa88146b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:22Z,use_quota=True,user_id='d4af1711846a407c8d9739acacbb6358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07e8459b-a09a-44c3-9ca8-20a836b68eba),volume_type_id=07e8459b-a09a-44c3-9ca8-20a836b68eba)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Creating volume 56bb91fa-7ab7-4b26-9be2-40cfd3094c69 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:22 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:22 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 1073741824 Jul 31 10:56:22 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:23 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 1073741824" returned: 0 in 0.886s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:23 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 Jul 31 10:56:23 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:23 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4e402d-058b-4c8e-9fbd-22994534f694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe8f71d-6e49-43e7-b58d-8381e64d96e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:23 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Volume volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 (56bb91fa-7ab7-4b26-9be2-40cfd3094c69): created successfully Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe8f71d-6e49-43e7-b58d-8381e64d96e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Flow 'volume_create_manager' (3e498b1b-cf1a-42fd-aa8e-0a97cec715ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4cb9c1f8-d45e-4195-8ff4-97537dcc70e6 tempest-GroupsTest-2075610648 None] Created volume successfully. Jul 31 10:56:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Acquiring lock "cinder-quobyte-56bb91fa-7ab7-4b26-9be2-40cfd3094c69" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Lock "cinder-quobyte-56bb91fa-7ab7-4b26-9be2-40cfd3094c69" acquired by "delete_volume" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:25 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9fb9b-62e0-4bf0-98bb-1f58567b3b23]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:25 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 Jul 31 10:56:25 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:26 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69" returned: 0 in 0.804s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:26 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69 Jul 31 10:56:26 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:27 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56bb91fa-7ab7-4b26-9be2-40cfd3094c69" returned: 0 in 0.789s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Lock "cinder-quobyte-56bb91fa-7ab7-4b26-9be2-40cfd3094c69" released by "delete_volume" :: held 1.674s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Created reservations ['79aed5b0-5a58-421d-8ea3-1724bf5e60f0'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:27 devstack cinder-volume[88837]: WARNING cinder.quota [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-465099234 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-465099234, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:27 devstack cinder-volume[88837]: WARNING cinder.quota [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-465099234 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-465099234, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Created reservations ['60040b25-9264-4f55-9834-e426808b87ef', '110efdab-f491-4783-ab81-8a676e8b8c7f', 'a8d65bc4-50ee-4a1a-a4ed-77c77c47f891', '311e30ee-7f06-4a9f-8329-602f651dd2fe'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:27 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:27 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:28 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.469s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-961e48f9-e9fa-4b35-bade-ddce4559347e tempest-GroupsTest-2075610648 None] Delete group completed successfully. Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Flow 'volume_create_manager' (c84082b0-632b-44d0-9d2b-abe4afb5b68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738469c7-0f7b-4c09-b1c4-6e6322aca42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738469c7-0f7b-4c09-b1c4-6e6322aca42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1752069862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379c62a-82ce-4bca-b49e-6d5d2b75d666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abf13ece90240128bccb8f874b4e6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:28Z,use_quota=True,user_id='2c547625867347b2a08d693545ff404d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61522e4-1f5b-4e76-b7eb-c34356e845d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61522e4-1f5b-4e76-b7eb-c34356e845d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb109725-37fd-4b9c-984c-56a2f51a938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb109725-37fd-4b9c-984c-56a2f51a938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5379c62a-82ce-4bca-b49e-6d5d2b75d666', 'volume_name': 'volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65fa598-193f-444e-b3f4-1c9a721bb032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65fa598-193f-444e-b3f4-1c9a721bb032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1dd5c6-2167-4d0a-9c52-c95b87712039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Volume 5379c62a-82ce-4bca-b49e-6d5d2b75d666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666', 'volume_size': 1} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1752069862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379c62a-82ce-4bca-b49e-6d5d2b75d666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abf13ece90240128bccb8f874b4e6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:28Z,use_quota=True,user_id='2c547625867347b2a08d693545ff404d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Creating volume 5379c62a-82ce-4bca-b49e-6d5d2b75d666 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:28 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:28 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 1073741824 Jul 31 10:56:28 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Created reservations ['8393ce9a-8e14-47f8-b121-591b73cc6494'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:28 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:28 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:29 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7bb2f9d3-ef7c-4b60-8bb8-dd55f8f636a0 tempest-GroupsTest-2075610648 None] Delete group completed successfully. Jul 31 10:56:29 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 1073741824" returned: 0 in 0.580s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:29 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 Jul 31 10:56:29 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:29 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1dd5c6-2167-4d0a-9c52-c95b87712039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870b5581-6307-44b1-85ba-5ad3cbea4fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Volume volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 (5379c62a-82ce-4bca-b49e-6d5d2b75d666): created successfully Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870b5581-6307-44b1-85ba-5ad3cbea4fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Flow 'volume_create_manager' (c84082b0-632b-44d0-9d2b-abe4afb5b68c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ea9b07bf-7e72-4afd-853d-b7d7a7cd05dc tempest-VolumeQuotasNegativeTestJSON-273084613 None] Created volume successfully. Jul 31 10:56:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5fbd1655-4931-4139-ae47-ef64f29786df tempest-GroupsTest-2075610648 None] Group tempest-GroupsTest-Group-2084489237: creating Jul 31 10:56:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5fbd1655-4931-4139-ae47-ef64f29786df tempest-GroupsTest-2075610648 None] Group tempest-GroupsTest-Group-2084489237: created successfully Jul 31 10:56:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5fbd1655-4931-4139-ae47-ef64f29786df tempest-GroupsTest-2075610648 None] Create group completed successfully. Jul 31 10:56:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Acquiring lock "cinder-5379c62a-82ce-4bca-b49e-6d5d2b75d666-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "cinder-5379c62a-82ce-4bca-b49e-6d5d2b75d666-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Acquiring lock "cinder-quobyte-5379c62a-82ce-4bca-b49e-6d5d2b75d666" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "cinder-quobyte-5379c62a-82ce-4bca-b49e-6d5d2b75d666" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:31 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[75357676-f111-47b4-851e-23cde4f622fd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:32 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 Jul 31 10:56:32 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Flow 'volume_create_manager' (3b0127fd-68af-41c5-901d-9650f9ee2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34933fb6-4a0e-4c40-ad07-712ef09b0b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34933fb6-4a0e-4c40-ad07-712ef09b0b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-433250426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89fde0fd-cbfe-483c-b6ca-993de8a0da0e,host='devstack@QuobyteHD#QuobyteHD',id=9058fb5f-da06-4641-99be-242fdd214c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dfd4e070a4eaf8e47df1fa88146b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:32Z,use_quota=True,user_id='d4af1711846a407c8d9739acacbb6358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59959b9e-1fe2-44a1-9d18-01a198c9f508),volume_type_id=59959b9e-1fe2-44a1-9d18-01a198c9f508)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8488cc8e-ab4a-4aa1-a0e4-5cba45dff804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8488cc8e-ab4a-4aa1-a0e4-5cba45dff804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f7f1ab-4c7f-430a-8957-f3f6a4995cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f7f1ab-4c7f-430a-8957-f3f6a4995cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9058fb5f-da06-4641-99be-242fdd214c06', 'volume_name': 'volume-9058fb5f-da06-4641-99be-242fdd214c06', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b93b147-554f-493b-a807-0e776029eeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:32 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b93b147-554f-493b-a807-0e776029eeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d21d3-9e03-42c4-aae6-f6a0c747fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:32 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Volume 9058fb5f-da06-4641-99be-242fdd214c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9058fb5f-da06-4641-99be-242fdd214c06', 'volume_size': 1} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89fde0fd-cbfe-483c-b6ca-993de8a0da0e,created_at=2026-07-31T08:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-433250426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89fde0fd-cbfe-483c-b6ca-993de8a0da0e,host='devstack@QuobyteHD#QuobyteHD',id=9058fb5f-da06-4641-99be-242fdd214c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dfd4e070a4eaf8e47df1fa88146b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:32Z,use_quota=True,user_id='d4af1711846a407c8d9739acacbb6358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59959b9e-1fe2-44a1-9d18-01a198c9f508),volume_type_id=59959b9e-1fe2-44a1-9d18-01a198c9f508)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Creating volume 9058fb5f-da06-4641-99be-242fdd214c06 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:32 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666" returned: 0 in 0.847s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:32 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 1073741824 Jul 31 10:56:32 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:32 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666 Jul 31 10:56:32 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:33 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-5379c62a-82ce-4bca-b49e-6d5d2b75d666" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "cinder-quobyte-5379c62a-82ce-4bca-b49e-6d5d2b75d666" released by "delete_volume" :: held 1.261s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Created reservations ['a549f1b4-ed58-4176-ad26-9876c0542419', 'fbd741ea-159e-4866-81ce-ff5747d09dc6', 'f767cabf-0dba-4df0-9070-0e8375aa2824', '4a3c1024-21ff-4d23-9c15-1e1e0e109ce1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:33 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:33 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:33 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 1073741824" returned: 0 in 0.639s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:33 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 Jul 31 10:56:33 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:33 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:33 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Deleted volume successfully. Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bb0a5269-3f1a-4609-a141-cc9329acfc85 tempest-VolumeQuotasNegativeTestJSON-273084613 None] Lock "cinder-5379c62a-82ce-4bca-b49e-6d5d2b75d666-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:33 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d21d3-9e03-42c4-aae6-f6a0c747fb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9058fb5f-da06-4641-99be-242fdd214c06', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb100527-4ca8-477b-a32b-beec40ec47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:33 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Volume volume-9058fb5f-da06-4641-99be-242fdd214c06 (9058fb5f-da06-4641-99be-242fdd214c06): created successfully Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb100527-4ca8-477b-a32b-beec40ec47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Flow 'volume_create_manager' (3b0127fd-68af-41c5-901d-9650f9ee2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:33 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1b0b4623-baeb-4df6-a9d9-493733a1a9d0 tempest-GroupsTest-2075610648 None] Created volume successfully. Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Flow 'volume_create_manager' (1a15e3e3-27d4-4559-949b-c511a3e0c95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55157194-4b73-47f0-90f9-d8107a2328ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55157194-4b73-47f0-90f9-d8107a2328ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8207312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89fde0fd-cbfe-483c-b6ca-993de8a0da0e,host='devstack@QuobyteHD#QuobyteHD',id=cf7c7415-a37f-4235-a30f-257846026e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dfd4e070a4eaf8e47df1fa88146b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:36Z,use_quota=True,user_id='d4af1711846a407c8d9739acacbb6358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59959b9e-1fe2-44a1-9d18-01a198c9f508),volume_type_id=59959b9e-1fe2-44a1-9d18-01a198c9f508)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac615dda-a9d8-472f-8b87-3ca9313fa3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac615dda-a9d8-472f-8b87-3ca9313fa3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b227209c-a37e-4c5a-95d4-bbc677c44405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b227209c-a37e-4c5a-95d4-bbc677c44405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7c7415-a37f-4235-a30f-257846026e96', 'volume_name': 'volume-cf7c7415-a37f-4235-a30f-257846026e96', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e2492f-3985-4bfa-ba66-9d22b7c8bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e2492f-3985-4bfa-ba66-9d22b7c8bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ecd5b4-7f84-4729-bf67-b2362649b004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:36 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Volume cf7c7415-a37f-4235-a30f-257846026e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7c7415-a37f-4235-a30f-257846026e96', 'volume_size': 1} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89fde0fd-cbfe-483c-b6ca-993de8a0da0e,created_at=2026-07-31T08:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-8207312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89fde0fd-cbfe-483c-b6ca-993de8a0da0e,host='devstack@QuobyteHD#QuobyteHD',id=cf7c7415-a37f-4235-a30f-257846026e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dfd4e070a4eaf8e47df1fa88146b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:36Z,use_quota=True,user_id='d4af1711846a407c8d9739acacbb6358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59959b9e-1fe2-44a1-9d18-01a198c9f508),volume_type_id=59959b9e-1fe2-44a1-9d18-01a198c9f508)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Creating volume cf7c7415-a37f-4235-a30f-257846026e96 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:36 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:36 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 1073741824 Jul 31 10:56:36 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:37 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 1073741824" returned: 0 in 0.751s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:37 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 Jul 31 10:56:37 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:37 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96" returned: 0 in 0.465s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ecd5b4-7f84-4729-bf67-b2362649b004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7c7415-a37f-4235-a30f-257846026e96', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a3c27e-0c04-4bd2-9f21-2ea0c716c69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Volume volume-cf7c7415-a37f-4235-a30f-257846026e96 (cf7c7415-a37f-4235-a30f-257846026e96): created successfully Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a3c27e-0c04-4bd2-9f21-2ea0c716c69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Flow 'volume_create_manager' (1a15e3e3-27d4-4559-949b-c511a3e0c95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-98380439-8c08-4800-942a-6d911e5cb5a0 tempest-GroupsTest-2075610648 None] Created volume successfully. Jul 31 10:56:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c17a1bd9-8a61-44c5-86f4-2e4c4138bbb4 tempest-GroupsTest-2075610648 None] Update group completed successfully. Jul 31 10:56:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6032f1b3-9680-423d-945f-bfc973773e8c tempest-GroupsTest-2075610648 None] Update group completed successfully. Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Flow 'volume_create_manager' (94c271d0-b76b-40b6-ba08-d9acfb61ed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4806a3-0324-4254-b723-1cd18124a13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4806a3-0324-4254-b723-1cd18124a13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-565797531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ed8558-1285-451f-896c-933dc163e429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc4f114227d4fd09efaf80bcc758a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:42Z,use_quota=True,user_id='e78313ab0cf84f3db51f866f43df88e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572239a9-0926-4d06-80d9-88251104685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572239a9-0926-4d06-80d9-88251104685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5146f9b9-646a-4010-a4b1-badc7dbdd1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5146f9b9-646a-4010-a4b1-badc7dbdd1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ed8558-1285-451f-896c-933dc163e429', 'volume_name': 'volume-14ed8558-1285-451f-896c-933dc163e429', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8bc440-a896-412a-b806-ffc7e0c0ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8bc440-a896-412a-b806-ffc7e0c0ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4372bbe-5d27-4262-a683-6cb3baa60a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:42 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Volume 14ed8558-1285-451f-896c-933dc163e429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ed8558-1285-451f-896c-933dc163e429', 'volume_size': 1} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-565797531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ed8558-1285-451f-896c-933dc163e429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc4f114227d4fd09efaf80bcc758a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:42Z,use_quota=True,user_id='e78313ab0cf84f3db51f866f43df88e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Creating volume 14ed8558-1285-451f-896c-933dc163e429 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:42 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:42 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 1073741824 Jul 31 10:56:42 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:43 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 1073741824" returned: 0 in 1.083s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:43 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 Jul 31 10:56:43 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Acquiring lock "cinder-quobyte-9058fb5f-da06-4641-99be-242fdd214c06" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Lock "cinder-quobyte-9058fb5f-da06-4641-99be-242fdd214c06" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:43 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429" returned: 0 in 0.351s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b47549b-75f6-4d23-9c44-f311a74f0809]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4372bbe-5d27-4262-a683-6cb3baa60a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ed8558-1285-451f-896c-933dc163e429', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa5884a-4f53-45fb-8c9d-d1eb7f214043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:43 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Volume volume-14ed8558-1285-451f-896c-933dc163e429 (14ed8558-1285-451f-896c-933dc163e429): created successfully Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa5884a-4f53-45fb-8c9d-d1eb7f214043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Flow 'volume_create_manager' (94c271d0-b76b-40b6-ba08-d9acfb61ed4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-95528c8b-f092-44cd-b878-a3c1d0e1ba8f tempest-AttachVolumeNegativeTest-406109207 None] Created volume successfully. Jul 31 10:56:43 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 Jul 31 10:56:43 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:44 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06" returned: 0 in 0.580s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:44 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06 Jul 31 10:56:44 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Flow 'volume_create_manager' (e7fe85fa-f852-4434-85a9-52b9d0632e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21fb588-70bf-4357-b541-4ea448cfb797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21fb588-70bf-4357-b541-4ea448cfb797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1540496216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddf2f1b-ee0c-4715-80b7-0c741228d28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82713837fb7f4b4086cdc24e270966c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:45Z,use_quota=True,user_id='c7722e39b7214d34850440b047391c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e4e4c0-de00-4d65-ab4e-9b95402b605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e4e4c0-de00-4d65-ab4e-9b95402b605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7651e5-f6b6-4923-80e4-2697ba9cb570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7651e5-f6b6-4923-80e4-2697ba9cb570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddf2f1b-ee0c-4715-80b7-0c741228d28d', 'volume_name': 'volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c41176-e310-420c-ac80-91ba99d927e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c41176-e310-420c-ac80-91ba99d927e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6508bac7-d8b8-47c0-855e-5c7293ef39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Volume 7ddf2f1b-ee0c-4715-80b7-0c741228d28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d', 'volume_size': 1} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1540496216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddf2f1b-ee0c-4715-80b7-0c741228d28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82713837fb7f4b4086cdc24e270966c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:45Z,use_quota=True,user_id='c7722e39b7214d34850440b047391c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Creating volume 7ddf2f1b-ee0c-4715-80b7-0c741228d28d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:44 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:44 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d 1073741824 Jul 31 10:56:44 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:44 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9058fb5f-da06-4641-99be-242fdd214c06" returned: 0 in 0.629s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Lock "cinder-quobyte-9058fb5f-da06-4641-99be-242fdd214c06" released by "delete_volume" :: held 1.311s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Acquiring lock "cinder-quobyte-cf7c7415-a37f-4235-a30f-257846026e96" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Lock "cinder-quobyte-cf7c7415-a37f-4235-a30f-257846026e96" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a2eec-dedb-400f-a682-0c0be205ace6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:45 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 Jul 31 10:56:45 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:45 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96" returned: 0 in 0.612s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:45 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96 Jul 31 10:56:45 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:45 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d 1073741824" returned: 0 in 0.902s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:45 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d Jul 31 10:56:45 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:46 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cf7c7415-a37f-4235-a30f-257846026e96" returned: 0 in 0.345s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Lock "cinder-quobyte-cf7c7415-a37f-4235-a30f-257846026e96" released by "delete_volume" :: held 1.012s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:46 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d" returned: 0 in 0.312s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.491s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Created reservations ['7fdd77f0-503d-4fd4-a2ed-1bd0a20e9014'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46004ee-e8ae-48ab-a4c7-1b08e041e82e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6508bac7-d8b8-47c0-855e-5c7293ef39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36675b8d-bb21-459b-8965-6f8a024999c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:46 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Volume volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d (7ddf2f1b-ee0c-4715-80b7-0c741228d28d): created successfully Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36675b8d-bb21-459b-8965-6f8a024999c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Flow 'volume_create_manager' (e7fe85fa-f852-4434-85a9-52b9d0632e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:46 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-70ed7ba6-1c84-44e3-9e54-ab848c5dbda3 tempest-VolumesListAdminTestJSON-1277033074 None] Created volume successfully. Jul 31 10:56:46 devstack cinder-volume[88837]: WARNING cinder.quota [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1506686506 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1506686506, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:46 devstack cinder-volume[88837]: WARNING cinder.quota [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1506686506 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1506686506, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Created reservations ['e5e9a58b-2b69-412b-ba7f-ec0f56771fcc', 'f115f4be-132b-4385-b099-0445d8bec87c', '80341566-8544-4fee-b732-da4ff0b9c1b7', 'fefbac0f-df97-49f4-9025-688f0b65d8c4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:46 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 Jul 31 10:56:46 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Created reservations ['0324e3c9-3ea6-4f00-ac3b-c931d630252f', 'adb982be-c5a6-4283-b5bb-21cb3358cca3', 'd2896396-ae81-4b44-9225-ed4cfc124d6d', '7aa491bb-6295-4560-b211-5d76f201e97a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:46 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:46 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:46 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.523s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:46 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:46 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-14ed8558-1285-451f-896c-933dc163e429', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c852b40e-99d5-4e62-8aba-06d745ee6aa1', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:56:46 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-05fe45cd-3d60-414e-bfeb-b8081246a222 req-caf10213-816b-4f74-8fff-b9f902c0c1af tempest-AttachVolumeNegativeTest-406109207 None] attachment_update completed successfully. Jul 31 10:56:46 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.435s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 8 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:56:47 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.402s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e48af8eb-9b45-4e53-ad8b-ecc359f7a74e tempest-GroupsTest-2075610648 None] Delete group completed successfully. Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Flow 'volume_create_manager' (d83a41ab-31fd-4c6e-957f-1311efe0e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b045690-7086-494a-a252-2fed86084773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b045690-7086-494a-a252-2fed86084773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-295892011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c01aa5-f74f-4baf-8849-ebbf381d64f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82713837fb7f4b4086cdc24e270966c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:47Z,use_quota=True,user_id='c7722e39b7214d34850440b047391c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c58017-8480-4f7b-b831-6b4e49fe6012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c58017-8480-4f7b-b831-6b4e49fe6012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda339ab-9b82-4b99-b2d8-b8b52213fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda339ab-9b82-4b99-b2d8-b8b52213fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c01aa5-f74f-4baf-8849-ebbf381d64f0', 'volume_name': 'volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73aa2d2c-a059-4745-be1d-729f01e307dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73aa2d2c-a059-4745-be1d-729f01e307dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74f066d-3413-44e6-a3d3-0c25ae3f46b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Volume 56c01aa5-f74f-4baf-8849-ebbf381d64f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0', 'volume_size': 1} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-295892011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c01aa5-f74f-4baf-8849-ebbf381d64f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82713837fb7f4b4086cdc24e270966c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:47Z,use_quota=True,user_id='c7722e39b7214d34850440b047391c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Creating volume 56c01aa5-f74f-4baf-8849-ebbf381d64f0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:47 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:47 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 1073741824 Jul 31 10:56:47 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 1073741824" returned: 0 in 0.657s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:48 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 Jul 31 10:56:48 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:48 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74f066d-3413-44e6-a3d3-0c25ae3f46b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9872f46-2748-41b9-b388-d201429969cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Volume volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 (56c01aa5-f74f-4baf-8849-ebbf381d64f0): created successfully Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9872f46-2748-41b9-b388-d201429969cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Flow 'volume_create_manager' (d83a41ab-31fd-4c6e-957f-1311efe0e77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ef64bb61-8a49-42ba-856b-3c3bee6fff71 tempest-VolumesListAdminTestJSON-1277033074 None] Created volume successfully. Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Flow 'volume_create_manager' (a35c3424-d21b-4309-b79f-543f11d89fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3730fcbd-d271-4eaf-8632-18e1696a7169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3730fcbd-d271-4eaf-8632-18e1696a7169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1810985628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf05f41-e1cf-4bc8-8b28-935722e61655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e28766c3f454922878467f20ad38552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:49Z,use_quota=True,user_id='fd883ac0a6ab4aa1adf9197689204f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d99f9ce-c806-4a59-b5ac-447ab172456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d99f9ce-c806-4a59-b5ac-447ab172456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e51d821-705e-40f8-bff9-ede5df0254e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e51d821-705e-40f8-bff9-ede5df0254e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf05f41-e1cf-4bc8-8b28-935722e61655', 'volume_name': 'volume-abf05f41-e1cf-4bc8-8b28-935722e61655', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10927a2e-3164-4603-b6bf-85f4ae595022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10927a2e-3164-4603-b6bf-85f4ae595022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b5fe6c-853b-4aff-b420-aa9b79b1642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:49 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Volume abf05f41-e1cf-4bc8-8b28-935722e61655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf05f41-e1cf-4bc8-8b28-935722e61655', 'volume_size': 1} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1810985628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf05f41-e1cf-4bc8-8b28-935722e61655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e28766c3f454922878467f20ad38552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:49Z,use_quota=True,user_id='fd883ac0a6ab4aa1adf9197689204f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Creating volume abf05f41-e1cf-4bc8-8b28-935722e61655 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:49 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:49 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 1073741824 Jul 31 10:56:49 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:49 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 1073741824" returned: 0 in 0.610s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:49 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 Jul 31 10:56:49 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:50 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655" returned: 0 in 0.371s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b5fe6c-853b-4aff-b420-aa9b79b1642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf05f41-e1cf-4bc8-8b28-935722e61655', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebfa008-fa80-4701-af3a-2cfefbca9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-411e43b5-47b8-4a8e-8a74-c3e9048f9af0 req-e8337e48-b6c7-435f-833b-b87f40995b75 tempest-AttachVolumeNegativeTest-406109207 None] Terminate volume connection completed successfully. Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-411e43b5-47b8-4a8e-8a74-c3e9048f9af0 req-e8337e48-b6c7-435f-833b-b87f40995b75 tempest-AttachVolumeNegativeTest-406109207 None] Deleting attachment c852b40e-99d5-4e62-8aba-06d745ee6aa1. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:56:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Volume volume-abf05f41-e1cf-4bc8-8b28-935722e61655 (abf05f41-e1cf-4bc8-8b28-935722e61655): created successfully Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebfa008-fa80-4701-af3a-2cfefbca9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Flow 'volume_create_manager' (a35c3424-d21b-4309-b79f-543f11d89fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5cf72ab6-dc20-42e5-a6ac-972538b6bfe9 tempest-ServersNegativeTestJSON-19954383 None] Created volume successfully. Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Flow 'volume_create_manager' (5ad42326-16d9-4fa8-a96b-a0ae5f12929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376a2020-db76-4031-8480-5ca69d9b72c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376a2020-db76-4031-8480-5ca69d9b72c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-265276451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afd717e-923b-4588-ab41-302f20ae47e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82713837fb7f4b4086cdc24e270966c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:50Z,use_quota=True,user_id='c7722e39b7214d34850440b047391c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ace52a7-f62a-4c58-9292-07935fb0f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ace52a7-f62a-4c58-9292-07935fb0f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87e4e62-df27-4efe-bcb0-553abdbc236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87e4e62-df27-4efe-bcb0-553abdbc236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8afd717e-923b-4588-ab41-302f20ae47e3', 'volume_name': 'volume-8afd717e-923b-4588-ab41-302f20ae47e3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a20013-bf5b-4528-af6c-d4154579d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a20013-bf5b-4528-af6c-d4154579d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bfd123-ca6d-4461-a8e5-ed445e5d2884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Volume 8afd717e-923b-4588-ab41-302f20ae47e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8afd717e-923b-4588-ab41-302f20ae47e3', 'volume_size': 1} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-265276451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8afd717e-923b-4588-ab41-302f20ae47e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82713837fb7f4b4086cdc24e270966c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:50Z,use_quota=True,user_id='c7722e39b7214d34850440b047391c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Creating volume 8afd717e-923b-4588-ab41-302f20ae47e3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:50 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:50 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 1073741824 Jul 31 10:56:50 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:51 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 1073741824" returned: 0 in 0.771s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:51 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 Jul 31 10:56:51 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:51 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3" returned: 0 in 0.544s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bfd123-ca6d-4461-a8e5-ed445e5d2884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8afd717e-923b-4588-ab41-302f20ae47e3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdaf658-a783-4515-955c-a7f6c7a738ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Volume volume-8afd717e-923b-4588-ab41-302f20ae47e3 (8afd717e-923b-4588-ab41-302f20ae47e3): created successfully Jul 31 10:56:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdaf658-a783-4515-955c-a7f6c7a738ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Flow 'volume_create_manager' (5ad42326-16d9-4fa8-a96b-a0ae5f12929a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-45c958c4-79d4-4a19-acd2-27528b6de77c tempest-VolumesListAdminTestJSON-1277033074 None] Created volume successfully. Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Flow 'volume_create_manager' (73f3be11-86a1-4156-b078-be35788a49ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848f4ed3-8b5c-4009-bad2-92f2049bf479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848f4ed3-8b5c-4009-bad2-92f2049bf479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1687340617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3af0100-02e9-469b-913d-91d9ac07d8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e28766c3f454922878467f20ad38552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:53Z,use_quota=True,user_id='fd883ac0a6ab4aa1adf9197689204f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d073bd67-8e69-4c0b-bcd7-18181f852398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d073bd67-8e69-4c0b-bcd7-18181f852398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ab2479-2066-461b-a2d0-bfb83fe40e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ab2479-2066-461b-a2d0-bfb83fe40e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3af0100-02e9-469b-913d-91d9ac07d8dd', 'volume_name': 'volume-d3af0100-02e9-469b-913d-91d9ac07d8dd', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80517ed-34ed-41d3-bd46-8f6a6b0c1998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80517ed-34ed-41d3-bd46-8f6a6b0c1998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfeebeed-37e4-4e43-816e-88a361fcc886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Volume d3af0100-02e9-469b-913d-91d9ac07d8dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3af0100-02e9-469b-913d-91d9ac07d8dd', 'volume_size': 1} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1687340617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3af0100-02e9-469b-913d-91d9ac07d8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e28766c3f454922878467f20ad38552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:53Z,use_quota=True,user_id='fd883ac0a6ab4aa1adf9197689204f03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Creating volume d3af0100-02e9-469b-913d-91d9ac07d8dd {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:53 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:53 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd 1073741824 Jul 31 10:56:53 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Flow 'volume_create_manager' (34f66b88-4cb0-445a-9bd7-ac04c9bc469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5705ae47-860d-41ce-aca7-b4ad5f478a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5705ae47-860d-41ce-aca7-b4ad5f478a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c282bc-7c19-470e-a30c-4e07f8aad805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1996a4fb61ee4a16953d1555106f7a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:54Z,use_quota=True,user_id='5be31f8ed6b3425190ac22b6aee1948a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef5e40e-9fe7-4780-a6e4-379e1b1ca6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef5e40e-9fe7-4780-a6e4-379e1b1ca6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af1ccd1-fb7f-4951-9d2b-2f814b4da5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af1ccd1-fb7f-4951-9d2b-2f814b4da5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c282bc-7c19-470e-a30c-4e07f8aad805', 'volume_name': 'volume-95c282bc-7c19-470e-a30c-4e07f8aad805', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2e7aba-f209-4764-aab8-e2c519184f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2e7aba-f209-4764-aab8-e2c519184f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4663608a-db4c-4171-ad6d-64845bc3cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Volume 95c282bc-7c19-470e-a30c-4e07f8aad805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c282bc-7c19-470e-a30c-4e07f8aad805', 'volume_size': 1} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:54 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd 1073741824" returned: 0 in 0.604s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:54 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd Jul 31 10:56:54 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:54 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd" returned: 0 in 0.262s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c282bc-7c19-470e-a30c-4e07f8aad805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1996a4fb61ee4a16953d1555106f7a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:54Z,use_quota=True,user_id='5be31f8ed6b3425190ac22b6aee1948a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Creating volume 95c282bc-7c19-470e-a30c-4e07f8aad805 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:54 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfeebeed-37e4-4e43-816e-88a361fcc886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3af0100-02e9-469b-913d-91d9ac07d8dd', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebca575-d066-4c97-8f26-4c133ddb25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:54 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 1073741824 Jul 31 10:56:54 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Volume volume-d3af0100-02e9-469b-913d-91d9ac07d8dd (d3af0100-02e9-469b-913d-91d9ac07d8dd): created successfully Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebca575-d066-4c97-8f26-4c133ddb25df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Flow 'volume_create_manager' (73f3be11-86a1-4156-b078-be35788a49ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fe584f52-51cd-470d-99f7-5037119846ba tempest-ServersNegativeTestJSON-19954383 None] Created volume successfully. Jul 31 10:56:54 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 1073741824" returned: 0 in 0.504s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1f04de81-e363-45d3-8d94-4ac285780b70 tempest-GroupsV314Test-1459233558 None] Group tempest-GroupsV314Test-Group-479253900: creating Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1f04de81-e363-45d3-8d94-4ac285780b70 tempest-GroupsV314Test-1459233558 None] Group tempest-GroupsV314Test-Group-479253900: created successfully Jul 31 10:56:55 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 Jul 31 10:56:55 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1f04de81-e363-45d3-8d94-4ac285780b70 tempest-GroupsV314Test-1459233558 None] Create group completed successfully. Jul 31 10:56:55 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805" returned: 0 in 0.315s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4663608a-db4c-4171-ad6d-64845bc3cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c282bc-7c19-470e-a30c-4e07f8aad805', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb137496-86fc-449c-a197-8e77213280a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Volume volume-95c282bc-7c19-470e-a30c-4e07f8aad805 (95c282bc-7c19-470e-a30c-4e07f8aad805): created successfully Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb137496-86fc-449c-a197-8e77213280a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Flow 'volume_create_manager' (34f66b88-4cb0-445a-9bd7-ac04c9bc469f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4f3342fc-cbd9-4e97-b5b8-14da38d55c08 tempest-VolumesListAdminTestJSON-669820547 None] Created volume successfully. Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "cinder-d3af0100-02e9-469b-913d-91d9ac07d8dd-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-d3af0100-02e9-469b-913d-91d9ac07d8dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "cinder-quobyte-d3af0100-02e9-469b-913d-91d9ac07d8dd" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-quobyte-d3af0100-02e9-469b-913d-91d9ac07d8dd" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[feedb418-829b-45e9-ba8f-ae413be4350c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Acquiring lock "cinder-95c282bc-7c19-470e-a30c-4e07f8aad805-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:56 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd Jul 31 10:56:56 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Lock "cinder-95c282bc-7c19-470e-a30c-4e07f8aad805-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Acquiring lock "cinder-quobyte-95c282bc-7c19-470e-a30c-4e07f8aad805" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Lock "cinder-quobyte-95c282bc-7c19-470e-a30c-4e07f8aad805" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2013da4-effe-4a2c-a96b-f69acb01f18c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "cinder-8afd717e-923b-4588-ab41-302f20ae47e3-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-8afd717e-923b-4588-ab41-302f20ae47e3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "cinder-quobyte-8afd717e-923b-4588-ab41-302f20ae47e3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "cinder-14ed8558-1285-451f-896c-933dc163e429-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-quobyte-8afd717e-923b-4588-ab41-302f20ae47e3" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-14ed8558-1285-451f-896c-933dc163e429-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a82e1a1-c7f3-4012-9fc1-94cbb4f193a1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:56 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 Jul 31 10:56:56 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "cinder-quobyte-14ed8558-1285-451f-896c-933dc163e429" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-quobyte-14ed8558-1285-451f-896c-933dc163e429" acquired by "delete_volume" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:56 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 Jul 31 10:56:56 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:56 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd" returned: 0 in 0.760s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0035c1-8767-40d8-8196-7dd8d0e89ddd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:56 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd Jul 31 10:56:56 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Flow 'volume_create_manager' (42582af9-732a-44b1-abb8-3143b894235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:57 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fdf625-684f-484e-9b0a-b2f29749efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:57 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49fdf625-684f-484e-9b0a-b2f29749efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646519722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24cf9ea9-a975-42ae-9222-3e8dbc648836,host='devstack@QuobyteHD#QuobyteHD',id=7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb7065f80914791866420209d0dc7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:57Z,use_quota=True,user_id='822bcc9a19394ca096e0f462cee1f561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddbf55a5-0a3a-4607-88e3-0e9a0e5e781a),volume_type_id=ddbf55a5-0a3a-4607-88e3-0e9a0e5e781a)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d14b862-dab6-41a9-80e6-47b540b00c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d14b862-dab6-41a9-80e6-47b540b00c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09fddc5-e805-482d-a712-cccc81582b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09fddc5-e805-482d-a712-cccc81582b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff', 'volume_name': 'volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c77d1-c20c-47ce-8616-8ea9299a7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0c77d1-c20c-47ce-8616-8ea9299a7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d71fbe-3b91-4a4f-8a74-b58ef725fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Volume 7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff', 'volume_size': 1} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24cf9ea9-a975-42ae-9222-3e8dbc648836,created_at=2026-07-31T08:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646519722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24cf9ea9-a975-42ae-9222-3e8dbc648836,host='devstack@QuobyteHD#QuobyteHD',id=7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb7065f80914791866420209d0dc7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:56:57Z,use_quota=True,user_id='822bcc9a19394ca096e0f462cee1f561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddbf55a5-0a3a-4607-88e3-0e9a0e5e781a),volume_type_id=ddbf55a5-0a3a-4607-88e3-0e9a0e5e781a)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Creating volume 7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:56:57 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:57 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff 1073741824 Jul 31 10:56:57 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805" returned: 0 in 0.827s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:57 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805 Jul 31 10:56:57 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3" returned: 0 in 0.659s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:57 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3af0100-02e9-469b-913d-91d9ac07d8dd" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3 Jul 31 10:56:57 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-quobyte-d3af0100-02e9-469b-913d-91d9ac07d8dd" released by "delete_volume" :: held 1.344s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Created reservations ['8a06cc8b-22b0-4124-890a-b94925c588b2', 'a7d7c5f1-f95c-42d4-95a1-77fb2f653ccb', 'e409cd2b-3320-4194-8591-d8755d68329d', '5f558400-5da3-4786-8a05-75e7f10bfa85'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:57 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429" returned: 0 in 0.592s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:57 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429 Jul 31 10:56:57 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:57 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-95c282bc-7c19-470e-a30c-4e07f8aad805" returned: 0 in 0.333s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:57 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Lock "cinder-quobyte-95c282bc-7c19-470e-a30c-4e07f8aad805" released by "delete_volume" :: held 1.219s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:57 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8afd717e-923b-4588-ab41-302f20ae47e3" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-quobyte-8afd717e-923b-4588-ab41-302f20ae47e3" released by "delete_volume" :: held 1.094s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Created reservations ['c09e8447-cbae-4b44-b2b8-990d5a89df83', '097072f7-23de-4975-8929-31a0b20944aa', 'd5cdf864-7681-4a1d-8174-fef3ed6ebb5c', '7bce406f-65af-414a-b8fd-bee8123e5c81'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:57 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-14ed8558-1285-451f-896c-933dc163e429" returned: 0 in 0.322s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff 1073741824" returned: 0 in 0.649s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-quobyte-14ed8558-1285-451f-896c-933dc163e429" released by "delete_volume" :: held 1.015s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:57 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Created reservations ['65f2363d-b722-4f77-9c24-d7eece1b6506', '158dba68-3ffc-4f02-a169-05119b10f866', 'bd64d84e-48be-4788-bef9-3ff954de466e', '1f542062-ef16-4c6f-8a94-8fed4afb275d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.356s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Deleted volume successfully. Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:57 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:56:57 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:58 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:58 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-58415947-513c-49bb-877d-2b94b9a98368 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-d3af0100-02e9-469b-913d-91d9ac07d8dd-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Created reservations ['bcf83e96-45e7-49c1-ad44-ba6aa17bf477', '252af73f-e389-4b48-9f90-999f3629357d', 'dfb495ce-1085-48a4-82bf-28bb66b238c1', 'c9f08879-4b25-46da-98c5-b523e7253771'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:58 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:58 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "cinder-abf05f41-e1cf-4bc8-8b28-935722e61655-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-abf05f41-e1cf-4bc8-8b28-935722e61655-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:58 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:58 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.467s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.424s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:58 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:58 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Deleted volume successfully. Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d71fbe-3b91-4a4f-8a74-b58ef725fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24f6d94-d261-47e5-8537-271571466df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "cinder-quobyte-abf05f41-e1cf-4bc8-8b28-935722e61655" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:58 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Volume volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff (7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff): created successfully Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24f6d94-d261-47e5-8537-271571466df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Flow 'volume_create_manager' (42582af9-732a-44b1-abb8-3143b894235d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68fa7777-62d4-4c9d-8f49-76f30e95af5c tempest-VolumesListAdminTestJSON-669820547 None] Lock "cinder-95c282bc-7c19-470e-a30c-4e07f8aad805-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-quobyte-abf05f41-e1cf-4bc8-8b28-935722e61655" acquired by "delete_volume" :: waited 0.044s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ad76f12d-41ef-493c-aa15-0b3d962921aa tempest-GroupsV314Test-1459233558 None] Created volume successfully. Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ceb28-4246-4b1b-9be0-eea8fa4da56e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:58 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.485s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Deleted volume successfully. Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f3ed9f6-9129-4134-8c93-ec4f1b8abf2c tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-8afd717e-923b-4588-ab41-302f20ae47e3-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:58 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 Jul 31 10:56:58 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:58 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.312s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Deleted volume successfully. Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-74d9d508-fdf3-4c1d-aa33-2f57a7e42762 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-14ed8558-1285-451f-896c-933dc163e429-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "cinder-56c01aa5-f74f-4baf-8849-ebbf381d64f0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:58 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655" returned: 0 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-56c01aa5-f74f-4baf-8849-ebbf381d64f0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:59 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655 Jul 31 10:56:59 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "cinder-quobyte-56c01aa5-f74f-4baf-8849-ebbf381d64f0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-quobyte-56c01aa5-f74f-4baf-8849-ebbf381d64f0" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe4a037-2074-4e5e-817e-cd2146ab78e9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "cinder-32a9a9a6-dee6-456a-8780-4237d7f4991a-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-32a9a9a6-dee6-456a-8780-4237d7f4991a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "cinder-quobyte-32a9a9a6-dee6-456a-8780-4237d7f4991a" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-quobyte-32a9a9a6-dee6-456a-8780-4237d7f4991a" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dfb9c7-c0ff-40e3-b8f9-32dff2b9645d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 Jul 31 10:56:59 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:59 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abf05f41-e1cf-4bc8-8b28-935722e61655" returned: 0 in 0.387s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-quobyte-abf05f41-e1cf-4bc8-8b28-935722e61655" released by "delete_volume" :: held 0.887s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:56:59 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a Jul 31 10:56:59 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Created reservations ['1bdda247-8760-457a-88cb-025e142fb1c3', '1abfa479-251f-4281-ade0-700ad08e66a7', 'c244d11c-ce71-4f0b-a134-6e37b5ec7b5e', '1de19f8b-3676-4d7c-ad66-cbf80be9e7c9'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:56:59 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:59 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0" returned: 0 in 0.602s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0 Jul 31 10:56:59 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:59 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a" returned: 0 in 0.583s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:56:59 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a Jul 31 10:56:59 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:56:59 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.362s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:56:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Deleted volume successfully. Jul 31 10:56:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7692993e-593c-406c-889b-aeb183296320 tempest-ServersNegativeTestJSON-19954383 None] Lock "cinder-abf05f41-e1cf-4bc8-8b28-935722e61655-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56c01aa5-f74f-4baf-8849-ebbf381d64f0" returned: 0 in 0.324s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-quobyte-56c01aa5-f74f-4baf-8849-ebbf381d64f0" released by "delete_volume" :: held 0.984s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Created reservations ['ce16570d-bece-4a17-9c30-f9d29f2d6c23', '33dce42b-9929-42e3-b22c-9fc7de42875a', 'f3d7a4be-b97f-4878-808c-6361fa153149', 'a91a0ef7-61ea-4798-94c7-3298351cd886'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:00 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-32a9a9a6-dee6-456a-8780-4237d7f4991a" returned: 0 in 0.307s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-quobyte-32a9a9a6-dee6-456a-8780-4237d7f4991a" released by "delete_volume" :: held 0.940s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:00 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:00 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Created reservations ['22f54d54-63d7-4530-962d-f9ffb370397c', 'd476628c-9a56-4d6d-aa55-6cb41b4fa5a6', '70ddb08b-1153-47ec-904d-143db87b7d49', 'e2de80da-1a4a-48e1-9ce8-884b205dedf7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:00 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Cloning volume 7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff to volume 0749015e-aed2-4322-8a25-2dbff05cc087 Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Creating offline snapshot b032cec1-df1b-4574-ac4c-7c39213d4c3e of volume 7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c6183-40c5-4c98-bfbf-6ad04ddf0edf]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:00 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:00 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:00 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.281s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Deleted volume successfully. Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ff0deaad-4683-4cb8-81f8-fac77aab5230 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-56c01aa5-f74f-4baf-8849-ebbf381d64f0-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:57:00 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:00 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.319s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Deleted volume successfully. Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ea3504e2-50a6-4a67-a08f-0fb6889736a0 tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-32a9a9a6-dee6-456a-8780-4237d7f4991a-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:00 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.479s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:00 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e 1G Jul 31 10:57:00 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "cinder-7ddf2f1b-ee0c-4715-80b7-0c741228d28d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-7ddf2f1b-ee0c-4715-80b7-0c741228d28d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "cinder-quobyte-7ddf2f1b-ee0c-4715-80b7-0c741228d28d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-quobyte-7ddf2f1b-ee0c-4715-80b7-0c741228d28d" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da1e753-4cbd-4fb2-b0d7-677cdb2567fb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:01 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e 1G" returned: 0 in 0.650s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:01 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e Jul 31 10:57:01 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:01 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d Jul 31 10:57:01 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "cinder-ade155e6-d44c-44cc-a956-e79160cab21f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-ade155e6-d44c-44cc-a956-e79160cab21f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "cinder-quobyte-ade155e6-d44c-44cc-a956-e79160cab21f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:02 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e" returned: 0 in 0.423s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-quobyte-ade155e6-d44c-44cc-a956-e79160cab21f" acquired by "delete_volume" :: waited 0.066s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:02 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e Jul 31 10:57:02 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d" returned: 0 in 0.559s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d Jul 31 10:57:02 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04fee67-8222-4d97-ab49-14e7753cf42a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f Jul 31 10:57:02 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7ddf2f1b-ee0c-4715-80b7-0c741228d28d" returned: 0 in 0.320s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-quobyte-7ddf2f1b-ee0c-4715-80b7-0c741228d28d" released by "delete_volume" :: held 0.953s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info Jul 31 10:57:02 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Created reservations ['a4bcec52-4302-44f1-b7c2-8c521f04660d', '8acec0ee-c230-4aef-922f-73cfcec2dafb', 'df6292a1-e9dd-4cbc-9c51-a90e6e4de2e4', 'e2399f72-d1bb-4f2b-96ea-e4f4ead79b6a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f" returned: 0 in 0.553s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:02 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f Jul 31 10:57:02 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:02 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info" returned: 0 in 0.419s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:02 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:57:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:02 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info Jul 31 10:57:02 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:03 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ade155e6-d44c-44cc-a956-e79160cab21f" returned: 0 in 0.327s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-quobyte-ade155e6-d44c-44cc-a956-e79160cab21f" released by "delete_volume" :: held 0.981s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Created reservations ['95aab16d-e162-4e78-b745-1b4b13cab469', '3659004c-4cd7-4016-8e82-81a3337aef15', 'cc793570-dac5-4a0c-8533-d366ab070005', '84f8fb8a-fe8d-466c-85f2-0958201b1ab1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:03 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.464s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Deleted volume successfully. Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-37ac9650-56a2-4316-9012-782731fa8153 tempest-VolumesListAdminTestJSON-1277033074 None] Lock "cinder-7ddf2f1b-ee0c-4715-80b7-0c741228d28d-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:03 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:03 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:03 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.info" returned: 0 in 0.381s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Acquiring lock "cinder-quobyte-0749015e-aed2-4322-8a25-2dbff05cc087" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-0749015e-aed2-4322-8a25-2dbff05cc087" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] snapshot: b032cec1-df1b-4574-ac4c-7c39213d4c3e, volume: 0749015e-aed2-4322-8a25-2dbff05cc087, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[920d2dd4-3770-459e-9705-6ddf3c7b7b1e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:03 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e Jul 31 10:57:03 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:03 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.309s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Deleted volume successfully. Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-648ceec3-e1ae-4644-bea6-312ac777200b tempest-AttachVolumeNegativeTest-406109207 None] Lock "cinder-ade155e6-d44c-44cc-a956-e79160cab21f-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:03 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d51627-4ee8-4871-9d93-57614edf76f1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:03 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:57:03 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:04 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.511s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:04 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 10:57:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:04 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 Jul 31 10:57:04 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:09 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087" returned: 0 in 5.449s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:09 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[659ae827-d05b-4f63-b7b9-31b32eb78398]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:09 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:57:09 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:10 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.750s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:10 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:57:10 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Converted 1024.00 MB image at 187.79 MB/s Jul 31 10:57:10 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 is being set with open permissions: ugo+rw: NotImplementedError Jul 31 10:57:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:10 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 Jul 31 10:57:10 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:10 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087" returned: 0 in 0.450s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-0749015e-aed2-4322-8a25-2dbff05cc087" released by "_copy_volume_from_snapshot" :: held 7.667s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Acquiring lock "cinder-quobyte-b032cec1-df1b-4574-ac4c-7c39213d4c3e" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-b032cec1-df1b-4574-ac4c-7c39213d4c3e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Deleting offline snapshot b032cec1-df1b-4574-ac4c-7c39213d4c3e of volume 7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] snapshot_file for this snap is: volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[af071525-66da-456c-b86c-9387879d38d4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:11 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e Jul 31 10:57:11 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:11 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e" returned: 0 in 0.502s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe553c-6e8f-4472-9294-368e00a80122]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:11 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:57:11 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:12 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.458s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:12 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e Jul 31 10:57:12 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:12 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e" returned: 0 in 0.591s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:12 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e Jul 31 10:57:12 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:12 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff.b032cec1-df1b-4574-ac4c-7c39213d4c3e" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-b032cec1-df1b-4574-ac4c-7c39213d4c3e" released by "_delete_snapshot" :: held 1.983s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.680s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:13 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-da321941-28ec-4a5b-a3ca-3f09090c6134 tempest-GroupsV314Test-1459233558 None] Create group from source-group-24cf9ea9-a975-42ae-9222-3e8dbc648836 completed successfully. Jul 31 10:57:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Acquiring lock "cinder-quobyte-0749015e-aed2-4322-8a25-2dbff05cc087" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-0749015e-aed2-4322-8a25-2dbff05cc087" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512d082-8723-4c7d-b3a4-96f90cae1d34]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:14 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 Jul 31 10:57:14 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:14 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087" returned: 0 in 0.410s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:14 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087 Jul 31 10:57:14 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:15 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0749015e-aed2-4322-8a25-2dbff05cc087" returned: 0 in 0.342s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-0749015e-aed2-4322-8a25-2dbff05cc087" released by "delete_volume" :: held 0.812s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Created reservations ['9ef5d3dc-d088-456a-9cf2-569c0860806c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:15 devstack cinder-volume[88837]: WARNING cinder.quota [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1516756439 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1516756439, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:15 devstack cinder-volume[88837]: WARNING cinder.quota [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1516756439 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1516756439, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Created reservations ['0daa2514-e839-414d-a454-97a9d27022ee', 'b474a541-0830-4ce8-9b2a-6c3eb20316c5', 'a0687a81-11ac-41d7-ba7f-5d0cd81c8655', '022e0f10-30d1-467c-82e4-afc730963d34'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:15 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:15 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:15 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.401s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:15 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:15 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a62b889-59a9-42af-9cbb-c32cadeddbbb tempest-GroupsV314Test-1459233558 None] Delete group completed successfully. Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Acquiring lock "cinder-quobyte-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" acquired by "delete_volume" :: waited 0.047s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fb4784-00a1-436c-baf5-59497ce56b12]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:57:16 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:16 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.466s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:16 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff Jul 31 10:57:16 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=137,cinder:UPDATE=185,cinder:INSERT=31,cinder:DELETE=10 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:57:16 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=131,cinder:UPDATE=156,cinder:INSERT=43,cinder:DELETE=12 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Flow 'volume_create_manager' (6ed1be49-a0e2-423b-bb18-15be9b08b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c45b7c1-388f-40f2-af91-19fc2b83dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c45b7c1-388f-40f2-af91-19fc2b83dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-864842124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149d0921-cb19-4531-bc44-770c0687f940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bcb4aa85c4e8d94209289a0d0426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:17Z,use_quota=True,user_id='64d561ebdff74b0c8714c5c4ab1ada95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6765f1-47b9-4237-9779-294457ac8ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6765f1-47b9-4237-9779-294457ac8ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55775931-c7da-4a6f-b6ee-c841c07aa609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 10:57:17 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" returned: 0 in 0.423s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Lock "cinder-quobyte-7546c8eb-4c1f-4fec-a5ad-41cccfdd60ff" released by "delete_volume" :: held 1.011s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Created reservations ['baba9adf-4f2c-46da-86d4-9099655c4821'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Created reservations ['c87b6406-b9d1-41e7-8cba-fbe8208409f6', 'fbc8f88e-02d3-4131-b46b-025827563084', 'ce640c84-3215-45c4-a435-31d95b642b79', '6bd9b762-7430-4b9c-9463-a2030591ef20'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:17 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:17 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55775931-c7da-4a6f-b6ee-c841c07aa609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '149d0921-cb19-4531-bc44-770c0687f940', 'volume_name': 'volume-149d0921-cb19-4531-bc44-770c0687f940', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adbbb55-c308-414a-91e0-328fe3fe4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8adbbb55-c308-414a-91e0-328fe3fe4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c26df58-57bf-41b9-9882-1522fb489873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:18 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Volume 149d0921-cb19-4531-bc44-770c0687f940: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-149d0921-cb19-4531-bc44-770c0687f940', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Trying to clone 149d0921-cb19-4531-bc44-770c0687f940 from image 054f039c-e113-4ed9-900a-f72893aac763 at location (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Flow 'volume_create_manager' (cb2e909d-514f-45dd-954c-8882ee0e65e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:18 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4ea0e3-46d5-4d8b-8ee9-1edf1788114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.433s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-010c4cc9-2ef9-411c-aade-392a75f8b422 tempest-GroupsV314Test-1459233558 None] Delete group completed successfully. Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4ea0e3-46d5-4d8b-8ee9-1edf1788114c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1290776116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182cc51a-60e5-4fd8-a465-771fa4bea3c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d062cf63dbbe4337bc2832f7f80d0236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:18Z,use_quota=True,user_id='a8909c3652fe4e04913a16603e0a90c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1fc3ec-d2d4-4412-8e9f-73ba801773ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1fc3ec-d2d4-4412-8e9f-73ba801773ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db15885d-1daa-4419-afa3-5935682679e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db15885d-1daa-4419-afa3-5935682679e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182cc51a-60e5-4fd8-a465-771fa4bea3c7', 'volume_name': 'volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3b5d0f-9330-4652-8591-6e82ef276854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3b5d0f-9330-4652-8591-6e82ef276854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1c517b-8d98-4a18-984c-936c5f17fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:18 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Volume 182cc51a-60e5-4fd8-a465-771fa4bea3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7', 'volume_size': 1} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1290776116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182cc51a-60e5-4fd8-a465-771fa4bea3c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d062cf63dbbe4337bc2832f7f80d0236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:18Z,use_quota=True,user_id='a8909c3652fe4e04913a16603e0a90c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Creating volume 182cc51a-60e5-4fd8-a465-771fa4bea3c7 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:18 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:18 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 1073741824 Jul 31 10:57:18 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 10:57:18 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Image download 20.69 MB at 20.69 MB/s Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[996814a4-d06e-4ea3-add2-55af5610a609]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:18 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD Jul 31 10:57:18 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:18 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 1073741824" returned: 0 in 0.543s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:18 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 Jul 31 10:57:18 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:18 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:18 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 is fetched for user 64d561ebdff74b0c8714c5c4ab1ada95. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a50686-e2e1-46eb-97e8-fe4826e8a316]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:19 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7" returned: 0 in 0.446s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1c517b-8d98-4a18-984c-936c5f17fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44d4f52-a2ea-44bb-a6dc-9adffff17402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:19 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Volume volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 (182cc51a-60e5-4fd8-a465-771fa4bea3c7): created successfully Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44d4f52-a2ea-44bb-a6dc-9adffff17402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Flow 'volume_create_manager' (cb2e909d-514f-45dd-954c-8882ee0e65e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:19 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD Jul 31 10:57:19 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-7d514e35-3435-4284-ba9e-b69d5f627173 req-3f786576-862b-4a52-b0f6-180741c3dd09 tempest-VolumesGetTestJSON-823481493 None] Created volume successfully. Jul 31 10:57:19 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-864842124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149d0921-cb19-4531-bc44-770c0687f940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='941bcb4aa85c4e8d94209289a0d0426b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:17Z,use_quota=True,user_id='64d561ebdff74b0c8714c5c4ab1ada95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Creating volume 149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:19 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:57:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:19 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 1073741824 Jul 31 10:57:19 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:20 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 1073741824" returned: 0 in 0.552s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:20 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:20 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:20 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 0 in 0.340s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Attempting download of 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 149d0921-cb19-4531-bc44-770c0687f940. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c067c-bfb8-44dc-a75d-5545ae07b5c4]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:20 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok Jul 31 10:57:20 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Acquiring lock "cinder-182cc51a-60e5-4fd8-a465-771fa4bea3c7-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Lock "cinder-182cc51a-60e5-4fd8-a465-771fa4bea3c7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Acquiring lock "cinder-quobyte-182cc51a-60e5-4fd8-a465-771fa4bea3c7" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Lock "cinder-quobyte-182cc51a-60e5-4fd8-a465-771fa4bea3c7" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ec5afc-031b-4283-a46a-78df2fd26372]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok" returned: 0 in 0.442s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 Jul 31 10:57:21 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:21 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok Jul 31 10:57:21 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:21 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok" returned: 1 in 0.420s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_5omrzjok' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8c48be-f9be-4bfc-9b8f-55f2e09b0477]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7" returned: 0 in 0.533s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7 Jul 31 10:57:21 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:21 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD Jul 31 10:57:21 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:21 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-182cc51a-60e5-4fd8-a465-771fa4bea3c7" returned: 0 in 0.304s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Lock "cinder-quobyte-182cc51a-60e5-4fd8-a465-771fa4bea3c7" released by "delete_volume" :: held 0.912s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG cinder.quota [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Created reservations ['a1e3f439-cce3-498a-80b8-a07e082f27d1', 'd1a74cba-cefe-4e1f-9a6a-02dacd1746ae', '03f93b51-5481-4b7b-840b-9346da1cc7ed', '975a54a7-d5c3-4ef5-9d35-2298c0e7eed6'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:21 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] 054f039c-e113-4ed9-900a-f72893aac763 was qcow2, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 10:57:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:21 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:21 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:22 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:22 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:22 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.562s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG cinder.manager [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Deleted volume successfully. Jul 31 10:57:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-5f59d3dc-d406-4ab0-94e1-c29464a88699 req-c8df69aa-bfe7-466f-a0f0-e646367d6604 tempest-VolumesGetTestJSON-823481493 None] Lock "cinder-182cc51a-60e5-4fd8-a465-771fa4bea3c7-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:24 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 0 in 2.450s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:24 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_df73yeoidevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:57:24 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Converted 112.00 MB image at 45.69 MB/s Jul 31 10:57:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:24 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 1G Jul 31 10:57:24 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:24 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 1G" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:24 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9486d-5523-4970-8ef3-6b26031cda82]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:25 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:25 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:25 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 0 in 0.515s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:25 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:25 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:26 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 1 in 0.620s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Downloaded image 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 149d0921-cb19-4531-bc44-770c0687f940 successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 for user 64d561ebdff74b0c8714c5c4ab1ada95 is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Marking volume 149d0921-cb19-4531-bc44-770c0687f940 as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Copying metadata from image 054f039c-e113-4ed9-900a-f72893aac763 to 149d0921-cb19-4531-bc44-770c0687f940. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Creating volume glance metadata for volume 149d0921-cb19-4531-bc44-770c0687f940 backed by image 054f039c-e113-4ed9-900a-f72893aac763 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c26df58-57bf-41b9-9882-1522fb489873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149d0921-cb19-4531-bc44-770c0687f940', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f10225f-924b-49db-91e9-6e93fa91a2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Volume volume-149d0921-cb19-4531-bc44-770c0687f940 (149d0921-cb19-4531-bc44-770c0687f940): created successfully Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f10225f-924b-49db-91e9-6e93fa91a2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Flow 'volume_create_manager' (6ed1be49-a0e2-423b-bb18-15be9b08b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-45cd2469-961c-49e0-b86f-d74b6fd2e9ca tempest-VolumesImageMetadata-1684212467 None] Created volume successfully. Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Flow 'volume_create_manager' (e04accd0-152d-4a04-9392-393ef5adfbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da3be91-a9c1-48b7-92ed-3128bebe4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da3be91-a9c1-48b7-92ed-3128bebe4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1642894241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40af6cad-2fb6-4813-bfa4-40f033f1b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc1a47e19f74f1bb6658955f5cb90f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:27Z,use_quota=True,user_id='0f1f724f9fa54158bf3560b3df62815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f8ec1e-fd80-4360-b09d-a164af1a92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f8ec1e-fd80-4360-b09d-a164af1a92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de81c8b-c44b-4af9-98df-385ddda5238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de81c8b-c44b-4af9-98df-385ddda5238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40af6cad-2fb6-4813-bfa4-40f033f1b118', 'volume_name': 'volume-40af6cad-2fb6-4813-bfa4-40f033f1b118', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b87343-e8c5-4eff-80b4-dadf0d667572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b87343-e8c5-4eff-80b4-dadf0d667572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25837f38-adcb-46e6-8e2e-550e9da59420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:27 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Volume 40af6cad-2fb6-4813-bfa4-40f033f1b118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40af6cad-2fb6-4813-bfa4-40f033f1b118', 'volume_size': 1} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1642894241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40af6cad-2fb6-4813-bfa4-40f033f1b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc1a47e19f74f1bb6658955f5cb90f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:27Z,use_quota=True,user_id='0f1f724f9fa54158bf3560b3df62815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Creating volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:27 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:27 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 1073741824 Jul 31 10:57:27 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Acquiring lock "cinder-149d0921-cb19-4531-bc44-770c0687f940-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Lock "cinder-149d0921-cb19-4531-bc44-770c0687f940-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Acquiring lock "cinder-quobyte-149d0921-cb19-4531-bc44-770c0687f940" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Lock "cinder-quobyte-149d0921-cb19-4531-bc44-770c0687f940" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[efef5f1e-c565-48b3-aa5d-20c5dce4e76b]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:27 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:27 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:27 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 1073741824" returned: 0 in 0.681s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:28 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 Jul 31 10:57:28 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:28 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 0 in 0.450s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:28 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:28 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:28 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25837f38-adcb-46e6-8e2e-550e9da59420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40af6cad-2fb6-4813-bfa4-40f033f1b118', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98315b25-ba2b-414b-a9ab-4c6fd35c94e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Volume volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 (40af6cad-2fb6-4813-bfa4-40f033f1b118): created successfully Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98315b25-ba2b-414b-a9ab-4c6fd35c94e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Flow 'volume_create_manager' (e04accd0-152d-4a04-9392-393ef5adfbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b5963793-f513-42de-80a5-4a90f052d191 tempest-SnapshotsActionsTest-1279264020 None] Created volume successfully. Jul 31 10:57:28 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 1 in 0.447s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:57:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:28 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940 Jul 31 10:57:28 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:29 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-149d0921-cb19-4531-bc44-770c0687f940" returned: 0 in 0.417s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Lock "cinder-quobyte-149d0921-cb19-4531-bc44-770c0687f940" released by "delete_volume" :: held 1.429s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Created reservations ['af3e0086-a253-4b2f-81fb-fbba17e4bca0', '82746486-07f3-4f26-a413-6673196d95ef', '5f697fcc-5d72-4853-bd21-7cca4b3ef185', '99828459-0164-4463-ac67-0f08ea5d8872'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:29 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:29 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Creating offline snapshot 17b1aad6-a3c7-4755-ac5a-aeb9613c555c of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2148b57-5d53-4950-98bd-e599347fb78f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:29 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.349s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:29 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 Jul 31 10:57:29 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Deleted volume successfully. Jul 31 10:57:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d788bdcd-3282-4c3c-a709-0dda320b64eb tempest-VolumesImageMetadata-1684212467 None] Lock "cinder-149d0921-cb19-4531-bc44-770c0687f940-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:30 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118" returned: 0 in 0.547s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:30 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c 1G Jul 31 10:57:30 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:30 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c 1G" returned: 0 in 0.538s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:30 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:30 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.416s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:31 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c is being set with open permissions: ugo+rw Jul 31 10:57:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:31 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:31 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.342s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:31 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info Jul 31 10:57:31 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:31 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info" returned: 0 in 0.334s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:31 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info is being set with open permissions: ugo+rw Jul 31 10:57:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:31 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info Jul 31 10:57:31 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:32 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.info" returned: 0 in 0.338s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5fe42ee1-61a6-4c33-83b3-93ee329aee59 tempest-SnapshotsActionsTest-1279264020 None] Create snapshot completed successfully Jul 31 10:57:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Creating offline snapshot 251c1560-f268-4152-bf63-cb3058565a20 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:33 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[49965893-b901-4a38-91c1-ee41bbfcb580]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:34 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:34 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:34 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.579s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:34 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 1G Jul 31 10:57:34 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:35 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 1G" returned: 0 in 0.714s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:35 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 Jul 31 10:57:35 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:35 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:35 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 is being set with open permissions: ugo+rw Jul 31 10:57:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:35 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 Jul 31 10:57:35 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:36 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20" returned: 0 in 0.388s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5ed31a93-000c-4fbf-a89b-a6b084c5530a tempest-SnapshotsActionsTest-1279264020 None] Create snapshot completed successfully Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-251c1560-f268-4152-bf63-cb3058565a20-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-251c1560-f268-4152-bf63-cb3058565a20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-251c1560-f268-4152-bf63-cb3058565a20" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-251c1560-f268-4152-bf63-cb3058565a20" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Deleting offline snapshot 251c1560-f268-4152-bf63-cb3058565a20 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] snapshot_file for this snap is: volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db25bef-2e23-44a2-a451-6662f2163a39]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:37 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 Jul 31 10:57:37 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:38 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20" returned: 0 in 0.759s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5d53f1-38eb-400a-9a65-dce3a6a5d211]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:38 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:38 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:38 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.504s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:38 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 Jul 31 10:57:38 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20" returned: 0 in 0.596s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:39 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20 Jul 31 10:57:39 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:39 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.251c1560-f268-4152-bf63-cb3058565a20" returned: 0 in 0.369s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-251c1560-f268-4152-bf63-cb3058565a20" released by "_delete_snapshot" :: held 2.431s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" released by "delete_snapshot" :: held 2.479s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:39 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Created reservations ['d516b630-c5ee-4863-9cb1-69691a5f40c1', 'dccaaec2-bf37-4fa1-9c56-85c25fcf1217', '8ce68ba8-2077-4781-8716-b198b05e3aef', '99b2832d-bd07-45d8-b261-51ff4be3a787'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Flow 'volume_create_manager' (fd517900-cdea-4b65-9c6d-b1acfc0e304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6758e7fd-8324-4aac-941d-9ab41849c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6758e7fd-8324-4aac-941d-9ab41849c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2015473228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4826eb-0659-4f46-8ff4-01f65f84c2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13704bfa8b34e69933565c5bce7fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:40Z,use_quota=True,user_id='8e33d0ae7b8e444fadc88ee3e37e5f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3f15a7-b0de-4568-820a-9a3a626b05f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3f15a7-b0de-4568-820a-9a3a626b05f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283fac98-9b32-484c-b938-2ed72411720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283fac98-9b32-484c-b938-2ed72411720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4826eb-0659-4f46-8ff4-01f65f84c2b6', 'volume_name': 'volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf1ce22-b117-4b5d-b29c-5d329279520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf1ce22-b117-4b5d-b29c-5d329279520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60375f06-1716-4600-a416-dc76c2199533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Volume 7c4826eb-0659-4f46-8ff4-01f65f84c2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6', 'volume_size': 1} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2015473228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4826eb-0659-4f46-8ff4-01f65f84c2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13704bfa8b34e69933565c5bce7fa39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:40Z,use_quota=True,user_id='8e33d0ae7b8e444fadc88ee3e37e5f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Creating volume 7c4826eb-0659-4f46-8ff4-01f65f84c2b6 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:40 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 1073741824 Jul 31 10:57:40 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:40 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Delete snapshot completed successfully. Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ed48ee88-1ffb-40b6-8c25-3f1059d0a56c tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-251c1560-f268-4152-bf63-cb3058565a20-delete_snapshot" released by "delete_snapshot" :: held 2.896s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:40 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 1073741824" returned: 0 in 0.681s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:40 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 Jul 31 10:57:40 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:41 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6" returned: 0 in 0.414s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.187s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60375f06-1716-4600-a416-dc76c2199533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1523e77b-0213-4677-ae0e-4cc4c2228818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Creating offline snapshot e9f26766-2d1f-4bdf-bfee-ea7019d23340 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:41 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Volume volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 (7c4826eb-0659-4f46-8ff4-01f65f84c2b6): created successfully Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1523e77b-0213-4677-ae0e-4cc4c2228818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Flow 'volume_create_manager' (fd517900-cdea-4b65-9c6d-b1acfc0e304f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56fdc0-c02d-4e1d-85a8-d10664bec68b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bbe71ea6-651f-4951-93c0-7c07dd32c0c8 tempest-AbsoluteLimitsTests-1436340043 None] Created volume successfully. Jul 31 10:57:41 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:41 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.663s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 1G Jul 31 10:57:42 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Acquiring lock "cinder-7c4826eb-0659-4f46-8ff4-01f65f84c2b6-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Lock "cinder-7c4826eb-0659-4f46-8ff4-01f65f84c2b6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Acquiring lock "cinder-quobyte-7c4826eb-0659-4f46-8ff4-01f65f84c2b6" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Lock "cinder-quobyte-7c4826eb-0659-4f46-8ff4-01f65f84c2b6" acquired by "delete_volume" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50d56c-37b6-4aed-ba79-e8daf54e112e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:42 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 1G" returned: 0 in 0.889s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 Jul 31 10:57:43 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 Jul 31 10:57:43 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6" returned: 0 in 0.494s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340" returned: 0 in 0.493s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 is being set with open permissions: ugo+rw Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:43 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6 Jul 31 10:57:43 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 Jul 31 10:57:43 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:43 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c4826eb-0659-4f46-8ff4-01f65f84c2b6" returned: 0 in 0.304s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Lock "cinder-quobyte-7c4826eb-0659-4f46-8ff4-01f65f84c2b6" released by "delete_volume" :: held 0.883s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:43 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340" returned: 0 in 0.356s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Created reservations ['6fc7a9d2-2137-46a0-a6b1-4a4f972696f0', '53a49167-3961-4cf9-b823-937a0736a01e', '8bf79623-a1f8-43f8-9325-bc84b1a2e9d9', 'c463755f-9493-4d79-8ccb-0f1abbae88da'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c5129cda-ba91-4c8e-829f-fecf8c0cfb62 tempest-SnapshotsActionsTest-1279264020 None] Create snapshot completed successfully Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:44 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:44 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Deleted volume successfully. Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1334f9ec-3e7a-4de1-a2d2-c93bc61a244f tempest-AbsoluteLimitsTests-1436340043 None] Lock "cinder-7c4826eb-0659-4f46-8ff4-01f65f84c2b6-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-e9f26766-2d1f-4bdf-bfee-ea7019d23340-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-e9f26766-2d1f-4bdf-bfee-ea7019d23340-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-e9f26766-2d1f-4bdf-bfee-ea7019d23340" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-e9f26766-2d1f-4bdf-bfee-ea7019d23340" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Deleting offline snapshot e9f26766-2d1f-4bdf-bfee-ea7019d23340 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] snapshot_file for this snap is: volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db4b30e-b787-4d0b-8f5e-0506e4b4065e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:44 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 Jul 31 10:57:44 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:45 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340" returned: 0 in 0.682s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[691ba8d1-a4c7-430e-940a-c793a8f62791]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:45 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:45 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:45 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.595s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:45 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 Jul 31 10:57:45 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:46 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340" returned: 0 in 0.662s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:46 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:46 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:46 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340 Jul 31 10:57:46 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:47 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.e9f26766-2d1f-4bdf-bfee-ea7019d23340" returned: 0 in 0.471s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:47 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.585s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-e9f26766-2d1f-4bdf-bfee-ea7019d23340" released by "_delete_snapshot" :: held 2.620s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" released by "delete_snapshot" :: held 2.658s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Created reservations ['1f1245a9-b26f-40fa-bbec-30bf68feade9', '5e3d347e-8846-420f-a3f2-76767d2cb66a', '5d7ab07b-7486-465b-b0f9-e2e67b9960b3', 'aae857fc-371b-46c5-b5a8-895fda650cfb'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Delete snapshot completed successfully. Jul 31 10:57:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-facfcbfe-ec86-477d-aeed-0ac170df0685 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-e9f26766-2d1f-4bdf-bfee-ea7019d23340-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Flow 'volume_create_manager' (9c50c8a8-73d6-4e0b-a00c-17b4b746d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b533fb32-5cea-4567-bf10-4b8ad7cc9514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b533fb32-5cea-4567-bf10-4b8ad7cc9514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-675213215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67a8f9e-4c6b-49f8-bbd6-c9483d286606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20de0e0220549bab37a2bffef3107a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:48Z,use_quota=True,user_id='5d06b2e4d1ce47f6b20523765c79b364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f11574ec-050c-4ee2-9018-b971977f91d8),volume_type_id=f11574ec-050c-4ee2-9018-b971977f91d8)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26b72fb-b61f-492f-807b-6ae7b8483ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26b72fb-b61f-492f-807b-6ae7b8483ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a8ca4a-6bb8-42bb-b993-43f68bb1c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a8ca4a-6bb8-42bb-b993-43f68bb1c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67a8f9e-4c6b-49f8-bbd6-c9483d286606', 'volume_name': 'volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf5d6ab-b0ae-4674-bc37-268bf65f9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf5d6ab-b0ae-4674-bc37-268bf65f9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a11f08-f8e3-45a8-b81f-45b0eee19b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Volume f67a8f9e-4c6b-49f8-bbd6-c9483d286606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606', 'volume_size': 1} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-675213215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67a8f9e-4c6b-49f8-bbd6-c9483d286606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20de0e0220549bab37a2bffef3107a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:48Z,use_quota=True,user_id='5d06b2e4d1ce47f6b20523765c79b364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f11574ec-050c-4ee2-9018-b971977f91d8),volume_type_id=f11574ec-050c-4ee2-9018-b971977f91d8)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Creating volume f67a8f9e-4c6b-49f8-bbd6-c9483d286606 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:48 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:48 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 1073741824 Jul 31 10:57:48 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:48 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 1073741824" returned: 0 in 0.677s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:49 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 Jul 31 10:57:49 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:49 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.997s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a11f08-f8e3-45a8-b81f-45b0eee19b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df40e1a-4fd3-4a62-9610-a8d10f2ba399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Creating offline snapshot b88684ff-0d37-4aa9-ac6d-058d107668a8 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:49 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Volume volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 (f67a8f9e-4c6b-49f8-bbd6-c9483d286606): created successfully Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df40e1a-4fd3-4a62-9610-a8d10f2ba399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Flow 'volume_create_manager' (9c50c8a8-73d6-4e0b-a00c-17b4b746d641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f2e1b-7e5e-468a-bd5a-65ecc5c6334e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4be723c2-2edd-401e-8861-23d1071d92bb tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Created volume successfully. Jul 31 10:57:49 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:49 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:50 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.520s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:50 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 1G Jul 31 10:57:50 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:50 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 1G" returned: 0 in 0.741s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:50 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 Jul 31 10:57:50 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:50 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:50 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:51 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8" returned: 0 in 0.388s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:51 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 is being set with open permissions: ugo+rw Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:51 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 Jul 31 10:57:51 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:51 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.410s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b4cf577c-f530-4898-a4b5-6702df56ae1d tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Retype volume completed successfully. Jul 31 10:57:51 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8" returned: 0 in 0.326s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f9061037-89d6-4a23-b32c-df17ff5a59be tempest-SnapshotsActionsTest-1279264020 None] Create snapshot completed successfully Jul 31 10:57:51 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Flow 'volume_create_manager' (5a8c7a80-e441-4182-9651-b609787fc615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc05179-7f10-4698-b09a-bb312ad6c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc05179-7f10-4698-b09a-bb312ad6c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-980258696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d63e6a1-c845-41c4-91aa-21a52ddf8369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cb20ff42eb4bbb9747d1b3cf191816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:52Z,use_quota=True,user_id='2c31196949ba496b9931337cfc032ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98523b82-f78d-4207-8097-de4261e247ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98523b82-f78d-4207-8097-de4261e247ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f48a5b-6608-4c2d-8179-fa321a2d68c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f48a5b-6608-4c2d-8179-fa321a2d68c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d63e6a1-c845-41c4-91aa-21a52ddf8369', 'volume_name': 'volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d9e5a3-0475-4d0e-8495-9b63a7d76b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d9e5a3-0475-4d0e-8495-9b63a7d76b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa41f9d-792c-4781-ab8d-ab6a4cd61a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Volume 8d63e6a1-c845-41c4-91aa-21a52ddf8369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369', 'volume_size': 1} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-980258696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d63e6a1-c845-41c4-91aa-21a52ddf8369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cb20ff42eb4bbb9747d1b3cf191816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:57:52Z,use_quota=True,user_id='2c31196949ba496b9931337cfc032ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Creating volume 8d63e6a1-c845-41c4-91aa-21a52ddf8369 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:57:52 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 1073741824 Jul 31 10:57:52 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Acquiring lock "cinder-f67a8f9e-4c6b-49f8-bbd6-c9483d286606-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "cinder-f67a8f9e-4c6b-49f8-bbd6-c9483d286606-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Acquiring lock "cinder-quobyte-f67a8f9e-4c6b-49f8-bbd6-c9483d286606" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "cinder-quobyte-f67a8f9e-4c6b-49f8-bbd6-c9483d286606" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a2776-9b51-4608-ba41-dbf948b587df]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 Jul 31 10:57:52 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 1073741824" returned: 0 in 0.567s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 Jul 31 10:57:52 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-b88684ff-0d37-4aa9-ac6d-058d107668a8-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606" returned: 0 in 0.484s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-b88684ff-0d37-4aa9-ac6d-058d107668a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:52 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606 Jul 31 10:57:52 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-b88684ff-0d37-4aa9-ac6d-058d107668a8" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-b88684ff-0d37-4aa9-ac6d-058d107668a8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Deleting offline snapshot b88684ff-0d37-4aa9-ac6d-058d107668a8 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] snapshot_file for this snap is: volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfc061a-100b-42c7-908e-650f96d8f805]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:53 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa41f9d-792c-4781-ab8d-ab6a4cd61a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48e76b0-27ea-4c17-a47e-433bdbcd1d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:57:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Volume volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 (8d63e6a1-c845-41c4-91aa-21a52ddf8369): created successfully Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48e76b0-27ea-4c17-a47e-433bdbcd1d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Flow 'volume_create_manager' (5a8c7a80-e441-4182-9651-b609787fc615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:57:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-97e0f684-46b4-4550-8059-2fb72521057d tempest-VolumesMetadataTest-1203278284 None] Created volume successfully. Jul 31 10:57:53 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 Jul 31 10:57:53 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:53 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f67a8f9e-4c6b-49f8-bbd6-c9483d286606" returned: 0 in 0.394s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "cinder-quobyte-f67a8f9e-4c6b-49f8-bbd6-c9483d286606" released by "delete_volume" :: held 0.927s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:53 devstack cinder-volume[88837]: WARNING cinder.quota [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:53 devstack cinder-volume[88837]: WARNING cinder.quota [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Created reservations ['de2c83aa-a427-4a08-b728-14b1ad9fc104', 'a9118962-35a6-487c-b368-ee61ffd6546b', 'e2a52e91-238b-4121-9095-90d31934f33c', '0bb18360-db57-45d5-8def-4312754c2dc7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:53 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:53 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:53 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8" returned: 0 in 0.493s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[93376de7-ded2-4a04-abfa-9d89b0814b93]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:53 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:53 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:53 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.270s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Deleted volume successfully. Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ffe1a5a-d26d-42a9-b035-b1d93f342bc4 tempest-VolumeRetypeWithoutMigrationTest-792766532 None] Lock "cinder-f67a8f9e-4c6b-49f8-bbd6-c9483d286606-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:53 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.380s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:53 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 Jul 31 10:57:53 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:54 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:54 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8 Jul 31 10:57:54 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:54 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.b88684ff-0d37-4aa9-ac6d-058d107668a8" returned: 0 in 0.372s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-b88684ff-0d37-4aa9-ac6d-058d107668a8" released by "_delete_snapshot" :: held 1.820s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" released by "delete_snapshot" :: held 1.857s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Created reservations ['d376a98d-dc7c-450d-bbcb-4c10c17daa93', '6500e745-edf3-4952-a2f3-d404f7fc5a0a', '5c92f5d4-e8ff-4dfc-b13c-16683a2c1fd1', 'eb2a08a7-bd3a-4080-a162-1bf3fdea4e96'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Delete snapshot completed successfully. Jul 31 10:57:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85d7b027-cffb-4469-ac6b-a6193bc32960 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-b88684ff-0d37-4aa9-ac6d-058d107668a8-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Acquiring lock "cinder-8d63e6a1-c845-41c4-91aa-21a52ddf8369-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Lock "cinder-8d63e6a1-c845-41c4-91aa-21a52ddf8369-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Acquiring lock "cinder-quobyte-8d63e6a1-c845-41c4-91aa-21a52ddf8369" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Lock "cinder-quobyte-8d63e6a1-c845-41c4-91aa-21a52ddf8369" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[06166eb7-0449-4eb6-ae21-12a80c3acba9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:55 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 Jul 31 10:57:55 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Creating offline snapshot 0518ac90-c403-4cd9-877b-d101114efe60 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a5409-003f-4d9c-b4c6-840ae01bd3aa]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:55 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369" returned: 0 in 0.507s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:55 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:55 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:55 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369 Jul 31 10:57:55 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:56 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d63e6a1-c845-41c4-91aa-21a52ddf8369" returned: 0 in 0.344s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:56 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Lock "cinder-quobyte-8d63e6a1-c845-41c4-91aa-21a52ddf8369" released by "delete_volume" :: held 0.924s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.500s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:56 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 1G Jul 31 10:57:56 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Created reservations ['06f0e089-d3c3-4f63-85ac-77e015f36f9d', '3d37103a-de0b-4fde-9941-2ce0d4ac8fa0', 'e191415d-beb4-4e72-8521-9f09466c4a17', '09f850c4-9590-4443-9899-d93132f8ecba'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:56 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:57:56 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:56 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:57:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Deleted volume successfully. Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-233976d9-36f1-43e5-9d7c-5e6032f98eb3 tempest-VolumesMetadataTest-1203278284 None] Lock "cinder-8d63e6a1-c845-41c4-91aa-21a52ddf8369-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:57:56 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 1G" returned: 0 in 0.750s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:56 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 Jul 31 10:57:56 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:57 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60" returned: 0 in 0.436s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:57 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 is being set with open permissions: ugo+rw Jul 31 10:57:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:57 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 Jul 31 10:57:57 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:57 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60" returned: 0 in 0.432s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:57:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d21fc135-a69f-4031-81d5-f88f9831a017 tempest-SnapshotsActionsTest-1279264020 None] Create snapshot completed successfully Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-0518ac90-c403-4cd9-877b-d101114efe60-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-0518ac90-c403-4cd9-877b-d101114efe60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Acquiring lock "cinder-quobyte-0518ac90-c403-4cd9-877b-d101114efe60" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-0518ac90-c403-4cd9-877b-d101114efe60" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Deleting offline snapshot 0518ac90-c403-4cd9-877b-d101114efe60 of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] snapshot_file for this snap is: volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e1e843-059a-4a49-adf5-2e641af91825]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:59 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 Jul 31 10:57:59 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:59 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60" returned: 0 in 0.464s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[75780cb6-721e-49b1-bc3b-0db663d9d40c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:59 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:57:59 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:57:59 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.469s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:57:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:57:59 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 Jul 31 10:57:59 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:00 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60" returned: 0 in 0.523s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:00 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60 Jul 31 10:58:00 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:00 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.0518ac90-c403-4cd9-877b-d101114efe60" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-0518ac90-c403-4cd9-877b-d101114efe60" released by "_delete_snapshot" :: held 1.877s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" released by "delete_snapshot" :: held 1.912s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Created reservations ['aeb48c54-a3b2-4451-8da8-cb6fd149b4e3', '4757494e-93f8-48de-b6b1-0a4ecd482597', '9ed33ab7-6c65-421b-8197-3ae621c260ec', '76e41dac-786a-441c-962e-f76039cd1d91'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Delete snapshot completed successfully. Jul 31 10:58:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdb1aa5d-fb96-4f23-adba-62e67db210e0 tempest-SnapshotsActionsTest-898522742 None] Lock "cinder-0518ac90-c403-4cd9-877b-d101114efe60-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "cinder-17b1aad6-a3c7-4755-ac5a-aeb9613c555c-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-17b1aad6-a3c7-4755-ac5a-aeb9613c555c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "cinder-quobyte-17b1aad6-a3c7-4755-ac5a-aeb9613c555c" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-quobyte-17b1aad6-a3c7-4755-ac5a-aeb9613c555c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Deleting offline snapshot 17b1aad6-a3c7-4755-ac5a-aeb9613c555c of volume 40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] snapshot_file for this snap is: volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce63d1d9-61e1-4e3a-8557-9bcada5f3c83]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:01 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:58:01 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:02 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.428s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40af6cad-2fb6-4813-bfa4-40f033f1b118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aaf18c-c346-41b5-8a1d-ae85e76417e3]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:02 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 Jul 31 10:58:02 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:02 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118" returned: 0 in 0.447s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:02 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:58:02 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:02 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.466s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:03 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c Jul 31 10:58:03 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:03 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118.17b1aad6-a3c7-4755-ac5a-aeb9613c555c" returned: 0 in 0.347s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-quobyte-17b1aad6-a3c7-4755-ac5a-aeb9613c555c" released by "_delete_snapshot" :: held 1.853s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" released by "delete_snapshot" :: held 1.894s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Created reservations ['a8d59e45-9867-4206-afff-804c26705acc', '1d657066-a723-4f91-9a9c-36aaf20502a6', 'affd8c91-2a5d-4373-8c29-90ef4088ba83', '5e2dba0b-8174-49c0-99e1-049c5843b167'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Delete snapshot completed successfully. Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c5fae7c-4f0c-4c00-aa88-56ebfdbf77c1 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-17b1aad6-a3c7-4755-ac5a-aeb9613c555c-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "cinder-40af6cad-2fb6-4813-bfa4-40f033f1b118-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-40af6cad-2fb6-4813-bfa4-40f033f1b118-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f20aa0-08e9-440e-9dfb-2ba3a7fe2749]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:04 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 Jul 31 10:58:04 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:04 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118" returned: 0 in 0.489s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:04 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118 Jul 31 10:58:04 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:04 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-40af6cad-2fb6-4813-bfa4-40f033f1b118" returned: 0 in 0.290s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-quobyte-40af6cad-2fb6-4813-bfa4-40f033f1b118" released by "delete_volume" :: held 0.853s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Created reservations ['80f18852-a302-4a7f-b423-1c8b84e394ac', '8bb878fd-66e9-4f00-b08a-4ddaa664e37e', 'f7dc3a9d-5e5d-4c58-9d93-bfe1667656a6', '08c3ce15-eda8-44ad-b403-8f3447071d29'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:04 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:58:04 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:05 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.436s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:05 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Deleted volume successfully. Jul 31 10:58:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-83a9a3a1-9b57-4a4c-ad8a-fb70c54156d4 tempest-SnapshotsActionsTest-1279264020 None] Lock "cinder-40af6cad-2fb6-4813-bfa4-40f033f1b118-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Flow 'volume_create_manager' (0fef2a53-8161-4d7d-8862-76014f10c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a617fa48-01ef-43f4-8060-a8daa4eb69cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a617fa48-01ef-43f4-8060-a8daa4eb69cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1697073417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1474e6e8334a91a979fb254d87a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:12Z,use_quota=True,user_id='8cc49c3232bb44a6b1021306c736884b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af8a8bd-21a5-487d-8c98-d84e7a34fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af8a8bd-21a5-487d-8c98-d84e7a34fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b657fb95-3526-4a15-8f50-a537a47c259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b657fb95-3526-4a15-8f50-a537a47c259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0', 'volume_name': 'volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1cb143-3ba0-4063-ac5a-39b194b953db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1cb143-3ba0-4063-ac5a-39b194b953db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a49a3b-370d-4e88-a3e8-74249db8712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:12 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Volume ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0', 'volume_size': 1} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1697073417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1474e6e8334a91a979fb254d87a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:12Z,use_quota=True,user_id='8cc49c3232bb44a6b1021306c736884b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Creating volume ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:12 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:58:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:12 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 1073741824 Jul 31 10:58:12 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:13 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 1073741824" returned: 0 in 0.691s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:13 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 Jul 31 10:58:13 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:13 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" returned: 0 in 0.391s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a49a3b-370d-4e88-a3e8-74249db8712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef7b68d-38b0-4158-a55f-3e60418b1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:13 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Volume volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 (ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0): created successfully Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef7b68d-38b0-4158-a55f-3e60418b1463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Flow 'volume_create_manager' (0fef2a53-8161-4d7d-8862-76014f10c919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:13 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f138fec6-9d6e-467c-ad6e-b12090f699b4 tempest-AttachVolumeTestJSON-1810948255 None] Created volume successfully. Jul 31 10:58:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e143e8-0d5a-493a-b924-5f5be6eade6c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:16 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 Jul 31 10:58:16 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Flow 'volume_create_manager' (704a4e26-73cc-4156-9f98-3fefb9835f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d15ec3e-0bd7-45e2-b9d5-44cd7e8dc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d15ec3e-0bd7-45e2-b9d5-44cd7e8dc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858427857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feade3f0-2f7f-466f-89dd-c8f2915fe47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2377d370873d47219c49a53bd4a0a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:16Z,use_quota=True,user_id='ad93c8c0b0dc4b55b11f22d3ff38b31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55bb9d2-453f-4307-bb0c-e2748d366cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55bb9d2-453f-4307-bb0c-e2748d366cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e340abb4-00a1-40f4-b031-f5944264663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e340abb4-00a1-40f4-b031-f5944264663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feade3f0-2f7f-466f-89dd-c8f2915fe47b', 'volume_name': 'volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e414a06-99ca-4eb4-abfa-54f66328177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e414a06-99ca-4eb4-abfa-54f66328177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90523ced-7058-4bd2-8476-f22f994307ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:16 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Volume feade3f0-2f7f-466f-89dd-c8f2915fe47b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b', 'volume_size': 1} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:16 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" returned: 0 in 0.556s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.593s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858427857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feade3f0-2f7f-466f-89dd-c8f2915fe47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2377d370873d47219c49a53bd4a0a736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:16Z,use_quota=True,user_id='ad93c8c0b0dc4b55b11f22d3ff38b31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Creating volume feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:16 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:16 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b 1073741824 Jul 31 10:58:16 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'debfd14f-a9ef-4295-b3dd-cc2eb5a1f9c4', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 10:58:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-a89416ab-b80b-465d-bd40-33d15cc6eb47 req-18c86c5d-b215-45c2-8b39-1013d731fdb3 tempest-AttachVolumeTestJSON-1810948255 None] attachment_update completed successfully. Jul 31 10:58:17 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b 1073741824" returned: 0 in 0.636s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=106,cinder:UPDATE=126,cinder:INSERT=38,cinder:DELETE=9 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=113,cinder:INSERT=32,cinder:UPDATE=115,cinder:DELETE=9 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:17 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:58:17 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:17 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.382s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90523ced-7058-4bd2-8476-f22f994307ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68d56c6-e6fc-48a6-ade4-dc7e3866296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:17 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Volume volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b (feade3f0-2f7f-466f-89dd-c8f2915fe47b): created successfully Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68d56c6-e6fc-48a6-ade4-dc7e3866296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Flow 'volume_create_manager' (704a4e26-73cc-4156-9f98-3fefb9835f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:17 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-74c8c3be-e40f-4bd1-a218-3f677f2ad01c tempest-VolumesActionsTest-1022718412 None] Created volume successfully. Jul 31 10:58:27 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:27 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Flow 'volume_create_manager' (1c63b6d3-53c0-4ff3-83ad-5d2fb3803f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b304e6-ff92-47c4-96a3-14afc5589299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b304e6-ff92-47c4-96a3-14afc5589299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1322519444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63ca013-c0e4-4a50-9ea5-e070793fec38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7a3d97aa7421289787ae2a4b5f4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:35Z,use_quota=True,user_id='a33613bee57d412ab018f8c8def6893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde27f25-c40e-4164-a259-e63f14716c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde27f25-c40e-4164-a259-e63f14716c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b0fa52-3066-47b8-be24-2fbed0986bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b0fa52-3066-47b8-be24-2fbed0986bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63ca013-c0e4-4a50-9ea5-e070793fec38', 'volume_name': 'volume-e63ca013-c0e4-4a50-9ea5-e070793fec38', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d778b27d-a443-4ce8-b332-57161408ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d778b27d-a443-4ce8-b332-57161408ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7926bad6-73b7-434c-9a2b-eedbc160c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Volume e63ca013-c0e4-4a50-9ea5-e070793fec38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63ca013-c0e4-4a50-9ea5-e070793fec38', 'volume_size': 1} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1322519444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63ca013-c0e4-4a50-9ea5-e070793fec38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d7a3d97aa7421289787ae2a4b5f4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:58:35Z,use_quota=True,user_id='a33613bee57d412ab018f8c8def6893a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Creating volume e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:34 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:58:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:34 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 1073741824 Jul 31 10:58:34 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 1073741824" returned: 0 in 1.120s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:36 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 Jul 31 10:58:36 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b2757c97-d362-4f19-a373-b127fb3a2d35 tempest-VolumesActionsTest-1022718412 None] Acquiring lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b" by "attach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b2757c97-d362-4f19-a373-b127fb3a2d35 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b" acquired by "attach_volume" :: waited 0.035s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:36 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38" returned: 0 in 0.656s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7926bad6-73b7-434c-9a2b-eedbc160c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63ca013-c0e4-4a50-9ea5-e070793fec38', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03453479-8c04-4fb2-872a-aff56239e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b2757c97-d362-4f19-a373-b127fb3a2d35 tempest-VolumesActionsTest-1022718412 None] Attaching volume feade3f0-2f7f-466f-89dd-c8f2915fe47b to instance 5873c55b-cc3a-4991-ba38-2db44854f5e2 at mountpoint /dev/vdb on host None. Jul 31 10:58:36 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Volume volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 (e63ca013-c0e4-4a50-9ea5-e070793fec38): created successfully Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03453479-8c04-4fb2-872a-aff56239e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Flow 'volume_create_manager' (1c63b6d3-53c0-4ff3-83ad-5d2fb3803f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c6aee591-176f-4faf-acd1-90c17d4a7600 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Created volume successfully. Jul 31 10:58:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b2757c97-d362-4f19-a373-b127fb3a2d35 tempest-VolumesActionsTest-1022718412 None] Attach volume completed successfully. Jul 31 10:58:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b2757c97-d362-4f19-a373-b127fb3a2d35 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b" released by "attach_volume" :: held 0.260s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f565fc0f-c5db-4566-bdad-f44c52426f66 tempest-VolumesActionsTest-1022718412 None] Acquiring lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-detach_volume" by "detach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f565fc0f-c5db-4566-bdad-f44c52426f66 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f565fc0f-c5db-4566-bdad-f44c52426f66 tempest-VolumesActionsTest-1022718412 None] Detaching volume feade3f0-2f7f-466f-89dd-c8f2915fe47b from instance 5873c55b-cc3a-4991-ba38-2db44854f5e2. Jul 31 10:58:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f565fc0f-c5db-4566-bdad-f44c52426f66 tempest-VolumesActionsTest-1022718412 None] Detach volume completed successfully. Jul 31 10:58:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f565fc0f-c5db-4566-bdad-f44c52426f66 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Creating offline snapshot 02244d4b-713e-4eaf-b9a3-0d7285bf911a of volume e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:58:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d2196e-9d40-44e3-8e82-1af06a5e1ebc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:38 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 Jul 31 10:58:38 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:39 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38" returned: 0 in 0.495s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:39 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a 1G Jul 31 10:58:39 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:39 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a 1G" returned: 0 in 0.578s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:39 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a Jul 31 10:58:39 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a" returned: 0 in 0.500s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a is being set with open permissions: ugo+rw Jul 31 10:58:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:40 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a Jul 31 10:58:40 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:40 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:40 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info Jul 31 10:58:40 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:41 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info" returned: 0 in 0.319s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:41 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info is being set with open permissions: ugo+rw Jul 31 10:58:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:41 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info Jul 31 10:58:41 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:41 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.info" returned: 0 in 0.397s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2e7eed31-7e69-44c4-99ac-f88d9c42007c tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Create snapshot completed successfully Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "cinder-02244d4b-713e-4eaf-b9a3-0d7285bf911a-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-02244d4b-713e-4eaf-b9a3-0d7285bf911a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "cinder-quobyte-e63ca013-c0e4-4a50-9ea5-e070793fec38" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-quobyte-e63ca013-c0e4-4a50-9ea5-e070793fec38" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "cinder-quobyte-02244d4b-713e-4eaf-b9a3-0d7285bf911a" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-quobyte-02244d4b-713e-4eaf-b9a3-0d7285bf911a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Deleting offline snapshot 02244d4b-713e-4eaf-b9a3-0d7285bf911a of volume e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] snapshot_file for this snap is: volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbaa04-c27b-4371-add0-429d34ba2836]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:42 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a Jul 31 10:58:42 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:43 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a" returned: 0 in 0.607s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e63ca013-c0e4-4a50-9ea5-e070793fec38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:58:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6330f8-710d-4528-8c73-6d5e68e2093f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:43 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 Jul 31 10:58:43 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:43 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:43 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a Jul 31 10:58:43 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:44 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a" returned: 0 in 0.761s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:44 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a Jul 31 10:58:44 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:45 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38.02244d4b-713e-4eaf-b9a3-0d7285bf911a" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-quobyte-02244d4b-713e-4eaf-b9a3-0d7285bf911a" released by "_delete_snapshot" :: held 2.544s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-quobyte-e63ca013-c0e4-4a50-9ea5-e070793fec38" released by "delete_snapshot" :: held 2.594s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:45 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Created reservations ['b4934c7e-44b9-4f7d-88ec-e23f124a2c5e', '8e51e401-9f41-49d1-aba5-5d1edc85e4a7', '5101ba5b-cbcc-4fc0-a704-ab9c7f13e1e0', 'bf0373e0-e5fc-4595-9381-df465fe49ff6'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Delete snapshot completed successfully. Jul 31 10:58:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-26136e99-a29e-4aa2-a7dd-e70b4490b617 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-02244d4b-713e-4eaf-b9a3-0d7285bf911a-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "cinder-e63ca013-c0e4-4a50-9ea5-e070793fec38-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-e63ca013-c0e4-4a50-9ea5-e070793fec38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "cinder-quobyte-e63ca013-c0e4-4a50-9ea5-e070793fec38" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-quobyte-e63ca013-c0e4-4a50-9ea5-e070793fec38" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[18af5523-ed2a-4fe6-987b-918e14b9aa75]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 Jul 31 10:58:46 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:58:46 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38" returned: 0 in 0.578s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:46 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38 Jul 31 10:58:46 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:46 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.412s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:58:47 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e63ca013-c0e4-4a50-9ea5-e070793fec38" returned: 0 in 0.380s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-quobyte-e63ca013-c0e4-4a50-9ea5-e070793fec38" released by "delete_volume" :: held 1.056s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Created reservations ['36260e40-4368-41c2-bef5-51ced8a1ff41', '5a3d5a04-c3eb-4905-8658-86a9a9bbc4a5', '760e8139-2790-48a2-b781-e3949ec22c01', '98083080-e5f0-4b0f-9693-ead6ade27048'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:47 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:58:47 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:58:47 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.392s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:58:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Deleted volume successfully. Jul 31 10:58:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3fb9a54c-9203-4470-9570-abc4712592a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-536309461 None] Lock "cinder-e63ca013-c0e4-4a50-9ea5-e070793fec38-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4f57fc2a-b0bc-4aea-9fca-70f33effb925 tempest-VolumesActionsTest-1022718412 None] Acquiring lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b" by "attach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4f57fc2a-b0bc-4aea-9fca-70f33effb925 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b" acquired by "attach_volume" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4f57fc2a-b0bc-4aea-9fca-70f33effb925 tempest-VolumesActionsTest-1022718412 None] Attaching volume feade3f0-2f7f-466f-89dd-c8f2915fe47b to instance d0dcf732-d455-4efb-a049-771c4f066b09 at mountpoint /dev/vdb on host None. Jul 31 10:58:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4f57fc2a-b0bc-4aea-9fca-70f33effb925 tempest-VolumesActionsTest-1022718412 None] Attach volume completed successfully. Jul 31 10:58:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4f57fc2a-b0bc-4aea-9fca-70f33effb925 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b" released by "attach_volume" :: held 0.258s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8151c6b6-3304-4e51-a8f0-8c4d8e861aaa tempest-VolumesActionsTest-1022718412 None] Acquiring lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-detach_volume" by "detach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:58:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8151c6b6-3304-4e51-a8f0-8c4d8e861aaa tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:58:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8151c6b6-3304-4e51-a8f0-8c4d8e861aaa tempest-VolumesActionsTest-1022718412 None] Detaching volume feade3f0-2f7f-466f-89dd-c8f2915fe47b from instance d0dcf732-d455-4efb-a049-771c4f066b09. Jul 31 10:58:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8151c6b6-3304-4e51-a8f0-8c4d8e861aaa tempest-VolumesActionsTest-1022718412 None] Detach volume completed successfully. Jul 31 10:58:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8151c6b6-3304-4e51-a8f0-8c4d8e861aaa tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Flow 'volume_create_manager' (5d9f5498-7428-4461-b31a-561c96b4ab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d30b7a4-f8ee-4509-994b-0ba53e1a16be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d30b7a4-f8ee-4509-994b-0ba53e1a16be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-95629542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3594372f-6f0c-435a-b767-815db3717c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabf2a05ae49459f97c508ec690e58ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:00Z,use_quota=True,user_id='87b9c77e7ab54b0bb9128d94a8f7714c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7afa8e4c-2531-4234-a1d4-a755c8443aba),volume_type_id=7afa8e4c-2531-4234-a1d4-a755c8443aba)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f687125-8de4-415a-b2b1-93d84ff4b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f687125-8de4-415a-b2b1-93d84ff4b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978fcb4c-1ced-4589-b55b-e585c1a55336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978fcb4c-1ced-4589-b55b-e585c1a55336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3594372f-6f0c-435a-b767-815db3717c59', 'volume_name': 'volume-3594372f-6f0c-435a-b767-815db3717c59', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd010d1-d505-4a47-9971-74d24e8be83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd010d1-d505-4a47-9971-74d24e8be83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aa2438-f11b-41ca-9a40-bae806df3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:58:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Volume 3594372f-6f0c-435a-b767-815db3717c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3594372f-6f0c-435a-b767-815db3717c59', 'volume_size': 1} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-95629542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3594372f-6f0c-435a-b767-815db3717c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabf2a05ae49459f97c508ec690e58ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:00Z,use_quota=True,user_id='87b9c77e7ab54b0bb9128d94a8f7714c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7afa8e4c-2531-4234-a1d4-a755c8443aba),volume_type_id=7afa8e4c-2531-4234-a1d4-a755c8443aba)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Creating volume 3594372f-6f0c-435a-b767-815db3717c59 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:58:59 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:58:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-7bbd9032-cb84-4e5b-82fa-bcef646544f7 req-ba5b1c81-5c8c-40fa-88f4-7d097eec6a8e tempest-AttachVolumeTestJSON-1810948255 None] Terminate volume connection completed successfully. Jul 31 10:58:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7bbd9032-cb84-4e5b-82fa-bcef646544f7 req-ba5b1c81-5c8c-40fa-88f4-7d097eec6a8e tempest-AttachVolumeTestJSON-1810948255 None] Deleting attachment debfd14f-a9ef-4295-b3dd-cc2eb5a1f9c4. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 10:58:59 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 1073741824 Jul 31 10:58:59 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:00 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 1073741824" returned: 0 in 1.136s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:01 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 Jul 31 10:59:01 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:01 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59" returned: 0 in 0.561s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aa2438-f11b-41ca-9a40-bae806df3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3594372f-6f0c-435a-b767-815db3717c59', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434f2ea1-715f-472b-9ab0-b8d616139c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (578de141-6a43-4a1d-a6ac-2e5742e56096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc8c2c1-a317-4c35-9f27-8de0284abe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Volume volume-3594372f-6f0c-435a-b767-815db3717c59 (3594372f-6f0c-435a-b767-815db3717c59): created successfully Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434f2ea1-715f-472b-9ab0-b8d616139c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Flow 'volume_create_manager' (5d9f5498-7428-4461-b31a-561c96b4ab0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc8c2c1-a317-4c35-9f27-8de0284abe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-432853999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:02Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f81df8-3b3a-4595-a4c4-7cb324f798fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f81df8-3b3a-4595-a4c4-7cb324f798fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e963e0d-937f-4c6e-bf4d-17f439af5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e963e0d-937f-4c6e-bf4d-17f439af5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e', 'volume_name': 'volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d2e633-1670-40b7-9aee-797bf656be88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9d2e633-1670-40b7-9aee-797bf656be88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f641b267-47aa-4b2a-b1cf-2615cad850c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Volume 3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e', 'volume_size': 1} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-432853999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:02Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Creating volume 3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:01 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:59:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b77f482c-cd73-4f4e-bce7-bb282c7dfc00 tempest-VolumeTypesAccessTest-1892960317 None] Created volume successfully. Jul 31 10:59:02 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e 1073741824 Jul 31 10:59:02 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Acquiring lock "cinder-3594372f-6f0c-435a-b767-815db3717c59-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Lock "cinder-3594372f-6f0c-435a-b767-815db3717c59-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Acquiring lock "cinder-quobyte-3594372f-6f0c-435a-b767-815db3717c59" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Lock "cinder-quobyte-3594372f-6f0c-435a-b767-815db3717c59" acquired by "delete_volume" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd87fd2d-b33a-49d2-8beb-dd1ea422257f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 Jul 31 10:59:02 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:02 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e 1073741824" returned: 0 in 0.815s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e Jul 31 10:59:02 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:02 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59" returned: 0 in 0.526s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:02 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59 Jul 31 10:59:02 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" returned: 0 in 0.305s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f641b267-47aa-4b2a-b1cf-2615cad850c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca699b7-6f8d-4e06-9b20-4713efc233f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Volume volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e (3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e): created successfully Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca699b7-6f8d-4e06-9b20-4713efc233f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (578de141-6a43-4a1d-a6ac-2e5742e56096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5361bf54-9c5b-43dc-afcd-cb879de7ba06 tempest-VolumesActionsTest-894784649 None] Created volume successfully. Jul 31 10:59:03 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3594372f-6f0c-435a-b767-815db3717c59" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Lock "cinder-quobyte-3594372f-6f0c-435a-b767-815db3717c59" released by "delete_volume" :: held 1.122s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:03 devstack cinder-volume[88837]: WARNING cinder.quota [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-738932006 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-738932006, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:03 devstack cinder-volume[88837]: WARNING cinder.quota [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-738932006 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-738932006, it is now deprecated. Please use the default quota class for default quota. Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Created reservations ['7d2c7418-f6ef-4252-9354-a907e8dc4fa5', '67474d9f-4c4e-46f6-b4ed-2595bd7a2b2f', 'c6aa9bde-e73a-40dd-b677-026a30b7195a', 'c4320ffe-d30f-4501-8003-d41f2ea935aa'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ce1f5ce6-69c2-4e9d-ad5e-1c48da5fe9d4 tempest-VolumesActionsTest-894784649 None] Acquiring lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" by "attach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ce1f5ce6-69c2-4e9d-ad5e-1c48da5fe9d4 tempest-VolumesActionsTest-894784649 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" acquired by "attach_volume" :: waited 0.050s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:03 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:59:03 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ce1f5ce6-69c2-4e9d-ad5e-1c48da5fe9d4 tempest-VolumesActionsTest-894784649 None] Attaching volume 3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e to instance dd0550a2-6cd2-456d-848f-b0d3550b9823 at mountpoint /dev/vdb on host None. Jul 31 10:59:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ce1f5ce6-69c2-4e9d-ad5e-1c48da5fe9d4 tempest-VolumesActionsTest-894784649 None] Attach volume completed successfully. Jul 31 10:59:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ce1f5ce6-69c2-4e9d-ad5e-1c48da5fe9d4 tempest-VolumesActionsTest-894784649 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" released by "attach_volume" :: held 0.189s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:04 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.552s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:04 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Deleted volume successfully. Jul 31 10:59:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f8ccdeb7-287f-44d6-8ef7-631c89c22b0a tempest-VolumeTypesAccessTest-1892960317 None] Lock "cinder-3594372f-6f0c-435a-b767-815db3717c59-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b23186e4-a356-473f-aae3-42ff98312855 tempest-VolumesActionsTest-1890865667 None] Terminate volume connection completed successfully. Jul 31 10:59:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b23186e4-a356-473f-aae3-42ff98312855 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-detach_volume" by "detach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b23186e4-a356-473f-aae3-42ff98312855 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b23186e4-a356-473f-aae3-42ff98312855 tempest-VolumesActionsTest-1890865667 None] Detaching volume 3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e from instance dd0550a2-6cd2-456d-848f-b0d3550b9823. Jul 31 10:59:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b23186e4-a356-473f-aae3-42ff98312855 tempest-VolumesActionsTest-1890865667 None] Detach volume completed successfully. Jul 31 10:59:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b23186e4-a356-473f-aae3-42ff98312855 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-detach_volume" released by "detach_volume" :: held 0.253s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-eed901e8-8d28-4b04-849d-a3c465af4b3c tempest-VolumesActionsTest-894784649 None] Acquiring lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-detach_volume" by "detach_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-eed901e8-8d28-4b04-849d-a3c465af4b3c tempest-VolumesActionsTest-894784649 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-eed901e8-8d28-4b04-849d-a3c465af4b3c tempest-VolumesActionsTest-894784649 None] Volume detach called, but volume not attached. Jul 31 10:59:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-eed901e8-8d28-4b04-849d-a3c465af4b3c tempest-VolumesActionsTest-894784649 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Acquiring lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Acquiring lock "cinder-quobyte-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Lock "cinder-quobyte-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" acquired by "delete_volume" :: waited 0.053s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84e2e22-d8f8-4310-b2cb-c38f6b8c0503]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:07 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e Jul 31 10:59:07 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd3a81-f443-4247-992d-b945ca7696e5]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:07 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:07 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:07 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" returned: 0 in 1.110s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:07 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e Jul 31 10:59:07 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:07 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.900s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff239de-a94c-4736-806a-f9c299b9ae24]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:08 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" returned: 0 in 0.540s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Lock "cinder-quobyte-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e" released by "delete_volume" :: held 1.810s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Created reservations ['65d2b5fa-7733-4a46-9212-b95f81a3d123', '077924ef-4293-434b-b5da-bbb6d1073fc9', '913d723c-1619-4f76-9150-d309ace7dbb1', '946db1c5-b840-4727-9fda-71d7442373df'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:59:08 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:08 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.822s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.ef90626d-be57-4f50-8e54-8eb9d8985c94vw677tg6.img {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:08 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.ef90626d-be57-4f50-8e54-8eb9d8985c94vw677tg6.img Jul 31 10:59:08 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:09 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.663s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:09 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Deleted volume successfully. Jul 31 10:59:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c817b7c5-eb28-435d-870f-b023dddc7527 tempest-VolumesActionsTest-894784649 None] Lock "cinder-3e9fb9f9-c1dd-4273-a3c2-7191ecdb146e-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:17 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.ef90626d-be57-4f50-8e54-8eb9d8985c94vw677tg6.img" returned: 0 in 8.833s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[221cfe8c-e221-46ea-a8c3-37a8240e4f6d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:17 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:17 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:18 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.597s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:18 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b, size 1024.00 MB, duration 8.83 sec, destination /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.ef90626d-be57-4f50-8e54-8eb9d8985c94vw677tg6.img {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:59:18 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Converted 1024.00 MB image at 115.91 MB/s Jul 31 10:59:18 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] ef90626d-be57-4f50-8e54-8eb9d8985c94 was raw, no need to convert to raw {{(pid=88837) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (cbf8e5e7-542b-4749-b6f5-897994280e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0a3402-5f04-468f-8a1d-ca05dfb39186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0a3402-5f04-468f-8a1d-ca05dfb39186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2084985499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1599746-0eac-4619-8815-94bc52a6526c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:19Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc51f2bb-ba1f-4252-b0fd-15879ad65293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc51f2bb-ba1f-4252-b0fd-15879ad65293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb7b7bf-4142-4978-85a2-b32019342c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb7b7bf-4142-4978-85a2-b32019342c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1599746-0eac-4619-8815-94bc52a6526c', 'volume_name': 'volume-f1599746-0eac-4619-8815-94bc52a6526c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857e2503-2b30-4fd2-8f45-40ddcb817908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (857e2503-2b30-4fd2-8f45-40ddcb817908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2ffca3-c4ca-4ec5-9b1d-317f55dc202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:19 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Volume f1599746-0eac-4619-8815-94bc52a6526c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1599746-0eac-4619-8815-94bc52a6526c', 'volume_size': 1} Jul 31 10:59:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:29 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=50,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:59:29 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=58,cinder:UPDATE=51,cinder:INSERT=12,cinder:DELETE=6 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Flow 'volume_create_manager' (de65c85d-11b6-4227-925f-94fe35f39948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b24d0e1-abfa-4755-95c1-8fc7abc004ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b24d0e1-abfa-4755-95c1-8fc7abc004ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1470847522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7886ec62-4cab-4831-a5a4-740d313c3642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32383dc453e8401b961ddc7e777fb183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:38Z,use_quota=True,user_id='e2ba69fa6c234e578c21c69d939b6e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9027fdbe-deff-4c19-8c72-3f937254bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9027fdbe-deff-4c19-8c72-3f937254bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2925dfe8-d027-4189-9393-94e3ca8173dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2925dfe8-d027-4189-9393-94e3ca8173dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7886ec62-4cab-4831-a5a4-740d313c3642', 'volume_name': 'volume-7886ec62-4cab-4831-a5a4-740d313c3642', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b637a386-78ae-4607-898b-168d1b0a1c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b637a386-78ae-4607-898b-168d1b0a1c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b0bd13-0866-4f6b-9a69-f02c9cf2e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Volume 7886ec62-4cab-4831-a5a4-740d313c3642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7886ec62-4cab-4831-a5a4-740d313c3642', 'volume_size': 1} Jul 31 10:59:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.163s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Uploaded volume to glance image-id: ef90626d-be57-4f50-8e54-8eb9d8985c94. {{(pid=88837) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.824s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2084985499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1599746-0eac-4619-8815-94bc52a6526c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:19Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Creating volume f1599746-0eac-4619-8815-94bc52a6526c {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:41 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:41 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c 1073741824 Jul 31 10:59:41 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0b48a214-b1af-4248-ade0-20fb8b5f49aa tempest-VolumesActionsTest-1022718412 None] Copy volume to image completed successfully. Jul 31 10:59:41 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c 1073741824" returned: 0 in 0.574s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:41 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c Jul 31 10:59:41 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c" returned: 0 in 0.281s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.188s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1470847522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7886ec62-4cab-4831-a5a4-740d313c3642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32383dc453e8401b961ddc7e777fb183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:38Z,use_quota=True,user_id='e2ba69fa6c234e578c21c69d939b6e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Creating volume 7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:42 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2ffca3-c4ca-4ec5-9b1d-317f55dc202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1599746-0eac-4619-8815-94bc52a6526c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:42 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 1073741824 Jul 31 10:59:42 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4690fee7-1608-4f38-9689-e8a9d31e3b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:42 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Volume volume-f1599746-0eac-4619-8815-94bc52a6526c (f1599746-0eac-4619-8815-94bc52a6526c): created successfully Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4690fee7-1608-4f38-9689-e8a9d31e3b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (cbf8e5e7-542b-4749-b6f5-897994280e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-31356342-bd8b-46fe-8ec7-08d565edb6e6 tempest-VolumesActionsTest-894784649 None] Created volume successfully. Jul 31 10:59:42 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 1073741824" returned: 0 in 0.538s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:42 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 Jul 31 10:59:42 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:42 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642" returned: 0 in 0.280s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b0bd13-0866-4f6b-9a69-f02c9cf2e84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7886ec62-4cab-4831-a5a4-740d313c3642', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d8a1fb-cfe1-42da-8275-ba212cb0e8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:43 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Volume volume-7886ec62-4cab-4831-a5a4-740d313c3642 (7886ec62-4cab-4831-a5a4-740d313c3642): created successfully Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d8a1fb-cfe1-42da-8275-ba212cb0e8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Flow 'volume_create_manager' (de65c85d-11b6-4227-925f-94fe35f39948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bdde9379-ad73-400b-9f05-9170f6446cc3 tempest-SnapshotMetadataTestJSON-1269618124 None] Created volume successfully. Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-f1599746-0eac-4619-8815-94bc52a6526c-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-f1599746-0eac-4619-8815-94bc52a6526c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-quobyte-f1599746-0eac-4619-8815-94bc52a6526c" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-f1599746-0eac-4619-8815-94bc52a6526c" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75c1b2-876e-46b2-b26f-6ad20153ff4a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92eb404-0cca-4f24-8043-f92228bb1635]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c Jul 31 10:59:43 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:43 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c" returned: 0 in 0.402s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:43 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c Jul 31 10:59:43 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:43 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.401s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b9aef8-4fd7-46d5-b965-fa99c1aacd6d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:44 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f1599746-0eac-4619-8815-94bc52a6526c" returned: 0 in 0.272s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-f1599746-0eac-4619-8815-94bc52a6526c" released by "delete_volume" :: held 0.739s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Created reservations ['e12069ed-f827-4855-a7e1-cf7fffa096fb', '988c3c8e-a494-4e7f-b0fb-3de0e8c2ae73', 'e6b6bead-d67d-400d-9cbe-f386c4f1c519', '666d2098-083b-4292-9815-8ca81a581e1d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:59:44 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.537s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:44 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img Jul 31 10:59:44 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:44 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.424s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Deleted volume successfully. Jul 31 10:59:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3db0a789-f66d-4534-b525-b861f90001b8 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-f1599746-0eac-4619-8815-94bc52a6526c-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (deec2580-5bd3-427a-b592-fe857c2dad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4212a518-006a-4751-95f2-5a4673c580a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4212a518-006a-4751-95f2-5a4673c580a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-271874186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17e3823-c555-4402-bb0a-a2d96258658c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:45Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8612455-862f-448d-ba96-efe0ddafa46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8612455-862f-448d-ba96-efe0ddafa46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1caae7-ace4-4008-b7b0-0d9464756d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1caae7-ace4-4008-b7b0-0d9464756d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17e3823-c555-4402-bb0a-a2d96258658c', 'volume_name': 'volume-a17e3823-c555-4402-bb0a-a2d96258658c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f28f33b-6b50-4728-9f20-11ed452ff84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f28f33b-6b50-4728-9f20-11ed452ff84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc7130c-c208-4ad4-a2ce-766e2a14a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:45 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Volume a17e3823-c555-4402-bb0a-a2d96258658c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17e3823-c555-4402-bb0a-a2d96258658c', 'volume_size': 1} Jul 31 10:59:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:46 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:59:46 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:47 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.624s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 10:59:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 10:59:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 10:59:49 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img" returned: 0 in 5.295s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:49 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa9aeb3-9e34-4719-b4a1-f857d4251bc6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:49 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:49 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.671s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:59:50 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Converted 1024.00 MB image at 193.35 MB/s Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] aff2edeb-5e15-4aaa-8ea7-c15b0b2be811 was raw, converting to qcow2 {{(pid=88837) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b120a1f-11a5-4d7b-8240-5660d9804aa6]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img Jul 31 10:59:50 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:50 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img" returned: 0 in 0.356s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:50 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img Jul 31 10:59:50 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img" returned: 1 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy Jul 31 10:59:51 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy" returned: 0 in 0.273s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Image conversion details: src /opt/stack/data/cinder/conversion/feade3f0-2f7f-466f-89dd-c8f2915fe47b.temp_image.aff2edeb-5e15-4aaa-8ea7-c15b0b2be811vhy61kfe.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 10:59:51 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[554940f0-8ba3-49b2-a6b5-a002ed0483b6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:51 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy Jul 31 10:59:51 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:51 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mlus2vuy" returned: 0 in 0.396s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.192s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Uploaded volume to glance image-id: aff2edeb-5e15-4aaa-8ea7-c15b0b2be811. {{(pid=88837) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 10:59:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.127s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Creating offline snapshot e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc of volume 7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 10:59:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e9021420-2a81-4c98-8188-10c9659a049d tempest-VolumesActionsTest-1022718412 None] Copy volume to image completed successfully. Jul 31 10:59:53 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f58b0e3-ec65-4126-860c-ddb7f15ee64b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:53 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 Jul 31 10:59:53 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:54 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:54 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc 1G Jul 31 10:59:54 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:54 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc 1G" returned: 0 in 0.532s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7886ec62-4cab-4831-a5a4-740d313c3642 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:54 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7886ec62-4cab-4831-a5a4-740d313c3642 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc Jul 31 10:59:54 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Acquiring lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Acquiring lock "cinder-quobyte-feade3f0-2f7f-466f-89dd-c8f2915fe47b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-quobyte-feade3f0-2f7f-466f-89dd-c8f2915fe47b" acquired by "delete_volume" :: waited 0.043s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:55 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7886ec62-4cab-4831-a5a4-740d313c3642 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" returned: 0 in 0.512s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc is being set with open permissions: ugo+rw Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0a251-b44e-43ff-ac43-71b80d86cc2f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc Jul 31 10:59:55 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:55 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" returned: 0 in 0.357s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info Jul 31 10:59:55 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b Jul 31 10:59:55 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:55 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info" returned: 0 in 0.324s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:55 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info is being set with open permissions: ugo+rw Jul 31 10:59:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:55 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info Jul 31 10:59:55 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-feade3f0-2f7f-466f-89dd-c8f2915fe47b" returned: 0 in 0.383s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-quobyte-feade3f0-2f7f-466f-89dd-c8f2915fe47b" released by "delete_volume" :: held 0.911s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Created reservations ['a6ff7df9-ffe4-4c0a-84d7-e4aef76287c1', '1ff98055-ddc5-4b7e-973a-eddb17674d53', 'deaacfa2-4eb8-459d-a546-1e9957b512e1', '1d0b02fc-71c1-4f4f-a9bd-daa22e64649d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 10:59:56 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.info" returned: 0 in 0.541s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.900s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.908s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T08:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-271874186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17e3823-c555-4402-bb0a-a2d96258658c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T08:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T08:59:45Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Creating volume a17e3823-c555-4402-bb0a-a2d96258658c {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 10:59:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:56 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c 1073741824 Jul 31 10:59:56 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f6b92e21-894e-4f3d-a893-5d4359e2e5bf tempest-SnapshotMetadataTestJSON-1269618124 None] Create snapshot completed successfully Jul 31 10:59:56 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.443s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 10:59:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Deleted volume successfully. Jul 31 10:59:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3d4528f6-1036-4031-b516-f93f70861254 tempest-VolumesActionsTest-1022718412 None] Lock "cinder-feade3f0-2f7f-466f-89dd-c8f2915fe47b-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:57 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c 1073741824" returned: 0 in 0.606s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:57 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c Jul 31 10:59:57 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:57 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c" returned: 0 in 0.432s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc7130c-c208-4ad4-a2ce-766e2a14a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17e3823-c555-4402-bb0a-a2d96258658c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76ef5ef-e7ec-4f42-b15e-434326593600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 10:59:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Volume volume-a17e3823-c555-4402-bb0a-a2d96258658c (a17e3823-c555-4402-bb0a-a2d96258658c): created successfully Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76ef5ef-e7ec-4f42-b15e-434326593600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 10:59:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (deec2580-5bd3-427a-b592-fe857c2dad43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 10:59:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-de011dff-e765-42c6-926c-9d8f0639de64 tempest-VolumesActionsTest-894784649 None] Created volume successfully. Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "cinder-e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "cinder-quobyte-7886ec62-4cab-4831-a5a4-740d313c3642" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-quobyte-7886ec62-4cab-4831-a5a4-740d313c3642" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "cinder-quobyte-e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-quobyte-e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Deleting offline snapshot e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc of volume 7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] snapshot_file for this snap is: volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2567841-d416-4657-a7bc-7c3a1b03eb11]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc Jul 31 10:59:58 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:58 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" returned: 0 in 0.492s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7886ec62-4cab-4831-a5a4-740d313c3642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-a17e3823-c555-4402-bb0a-a2d96258658c-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfd439e-a1b3-482e-b499-d0f259a1e076]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Lock "cinder-a17e3823-c555-4402-bb0a-a2d96258658c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-quobyte-a17e3823-c555-4402-bb0a-a2d96258658c" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-a17e3823-c555-4402-bb0a-a2d96258658c" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e534879-3039-4fde-9cbc-3ace53f7fe10]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 Jul 31 10:59:59 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c Jul 31 10:59:59 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642" returned: 0 in 0.578s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc Jul 31 10:59:59 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c" returned: 0 in 0.546s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 10:59:59 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c Jul 31 10:59:59 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 10:59:59 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a17e3823-c555-4402-bb0a-a2d96258658c" returned: 0 in 0.306s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 10:59:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-a17e3823-c555-4402-bb0a-a2d96258658c" released by "delete_volume" :: held 0.903s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 10:59:59 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc Jul 31 11:00:00 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Created reservations ['17c94213-6b4c-4015-b99b-ecb14583cb73', 'e012cba8-4f4a-4bd3-9690-2efbc7bdcaf5', '0afd5c9c-33a0-4a48-bb88-6c44012f0c8c', '9d649e5f-e9ef-4546-bc89-30bfed38a47c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:00 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:00 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:00 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642.e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" returned: 0 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-quobyte-e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc" released by "_delete_snapshot" :: held 2.211s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:00 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.308s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-quobyte-7886ec62-4cab-4831-a5a4-740d313c3642" released by "delete_snapshot" :: held 2.253s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Deleted volume successfully. Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ae04e7f-488c-4eb3-8af0-b88c43a823be tempest-VolumesActionsTest-1890865667 None] Lock "cinder-a17e3823-c555-4402-bb0a-a2d96258658c-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Created reservations ['961eeba7-6ca0-4a4b-8c1a-de47772e1dd8', '3924f2d0-33f8-4d3c-ad16-876b6696da70', '40816baf-c959-425c-a235-3add6573204a', 'f3602e94-fc8e-4f44-bb59-95a8e43b44e5'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Delete snapshot completed successfully. Jul 31 11:00:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c74f1b1-ff9c-4a43-9085-2a734d92a2bd tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-e5f003c5-101c-4d78-b5f6-bcc3bb6e58bc-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "cinder-7886ec62-4cab-4831-a5a4-740d313c3642-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-7886ec62-4cab-4831-a5a4-740d313c3642-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "cinder-quobyte-7886ec62-4cab-4831-a5a4-740d313c3642" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-quobyte-7886ec62-4cab-4831-a5a4-740d313c3642" acquired by "delete_volume" :: waited 0.037s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7b694-9ecb-427b-8563-b39393524bb9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (3f230a7e-7266-4ba6-ad3e-a45e58bb2a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5994493-5b71-48eb-afa3-49426ad95401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:02 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 Jul 31 11:00:02 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5994493-5b71-48eb-afa3-49426ad95401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877610368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b480176-5a6c-4113-b9a9-dd12a4224839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:02Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb23a98a-ab9f-4f6c-81c1-2ef3820ef302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb23a98a-ab9f-4f6c-81c1-2ef3820ef302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af46ddb-b859-4e3a-9a26-06e8dfb0b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af46ddb-b859-4e3a-9a26-06e8dfb0b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b480176-5a6c-4113-b9a9-dd12a4224839', 'volume_name': 'volume-2b480176-5a6c-4113-b9a9-dd12a4224839', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a19f98-1fc3-4145-9d62-6668468ece7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a19f98-1fc3-4145-9d62-6668468ece7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1f07ff-9e46-4aa4-914a-6865c4111861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:02 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Volume 2b480176-5a6c-4113-b9a9-dd12a4224839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b480176-5a6c-4113-b9a9-dd12a4224839', 'volume_size': 1} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877610368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b480176-5a6c-4113-b9a9-dd12a4224839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:02Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Creating volume 2b480176-5a6c-4113-b9a9-dd12a4224839 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:02 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 1073741824 Jul 31 11:00:02 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:02 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642" returned: 0 in 0.742s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:02 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642 Jul 31 11:00:02 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7886ec62-4cab-4831-a5a4-740d313c3642" returned: 0 in 0.468s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 1073741824" returned: 0 in 0.936s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-quobyte-7886ec62-4cab-4831-a5a4-740d313c3642" released by "delete_volume" :: held 1.292s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 Jul 31 11:00:03 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Created reservations ['e004c50e-1715-4912-a341-4fe3d3b4f72c', '94e02c56-2b21-47ae-b75a-c78e1e540789', '266f300c-7cb0-44fe-aecb-d2b04a6eeb0c', '75d2ddeb-03a5-4d2b-8244-c34bf01060d4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:03 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:03 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:03 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1f07ff-9e46-4aa4-914a-6865c4111861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b480176-5a6c-4113-b9a9-dd12a4224839', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f39c89-77b2-4a0a-b2c4-cadd9efcb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Volume volume-2b480176-5a6c-4113-b9a9-dd12a4224839 (2b480176-5a6c-4113-b9a9-dd12a4224839): created successfully Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f39c89-77b2-4a0a-b2c4-cadd9efcb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (3f230a7e-7266-4ba6-ad3e-a45e58bb2a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-20a76587-6457-4cad-b762-58480a32d2e3 tempest-VolumesActionsTest-894784649 None] Created volume successfully. Jul 31 11:00:03 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Deleted volume successfully. Jul 31 11:00:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-118eeb31-947b-4d21-9e4d-64561e81422b tempest-SnapshotMetadataTestJSON-1269618124 None] Lock "cinder-7886ec62-4cab-4831-a5a4-740d313c3642-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-2b480176-5a6c-4113-b9a9-dd12a4224839-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-2b480176-5a6c-4113-b9a9-dd12a4224839-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-quobyte-2b480176-5a6c-4113-b9a9-dd12a4224839" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-2b480176-5a6c-4113-b9a9-dd12a4224839" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[72acf7f4-90ba-48c5-91dd-1c37d1f9d86c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:04 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 Jul 31 11:00:04 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:04 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839" returned: 0 in 0.525s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839 Jul 31 11:00:05 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-2b480176-5a6c-4113-b9a9-dd12a4224839" returned: 0 in 0.380s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-2b480176-5a6c-4113-b9a9-dd12a4224839" released by "delete_volume" :: held 0.979s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Created reservations ['8a112932-03c6-4a6a-85f7-f30c52ab80e1', '1cdd47aa-dce8-4e37-9998-7d438b9a70f3', '836ca35a-636c-4621-87c8-4b6755aab615', '613b4c57-3dfb-435d-b8ba-44253353dac2'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:05 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:05 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:05 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.397s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Deleted volume successfully. Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-82024716-9823-4737-be15-786dc181a9f5 tempest-VolumesActionsTest-1890865667 None] Lock "cinder-2b480176-5a6c-4113-b9a9-dd12a4224839-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Flow 'volume_create_manager' (a9be72bf-3f9f-4828-83ae-50ca24bb6698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc1b622-cdca-400f-bb2e-3c186ed19a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc1b622-cdca-400f-bb2e-3c186ed19a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-7856275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f49b9a-9769-482c-805e-94a1691aacb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306b695fae844276a7ce4fe2653e4df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:06Z,use_quota=True,user_id='0f61fed28a624db197edbcfd419f20f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5185560b-ba70-46fe-81c3-bf7a2b37cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5185560b-ba70-46fe-81c3-bf7a2b37cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed68101-17b0-4dcc-8fd1-88d42846330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed68101-17b0-4dcc-8fd1-88d42846330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f49b9a-9769-482c-805e-94a1691aacb0', 'volume_name': 'volume-56f49b9a-9769-482c-805e-94a1691aacb0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7af6bc-4d3e-4253-b7dc-d58d4dc59134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7af6bc-4d3e-4253-b7dc-d58d4dc59134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7e2377-e4bf-4800-ad03-a10e5923ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:06 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Volume 56f49b9a-9769-482c-805e-94a1691aacb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f49b9a-9769-482c-805e-94a1691aacb0', 'volume_size': 1} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-7856275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f49b9a-9769-482c-805e-94a1691aacb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306b695fae844276a7ce4fe2653e4df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:06Z,use_quota=True,user_id='0f61fed28a624db197edbcfd419f20f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Creating volume 56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:06 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:06 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 1073741824 Jul 31 11:00:06 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 1073741824" returned: 0 in 0.712s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:07 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (c43b31ef-3d27-4df7-933f-e36b8b0a2aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8575c624-b122-4bf1-ab61-cef611fe1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8575c624-b122-4bf1-ab61-cef611fe1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911229610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ff69f6-3053-4f68-9ce6-b495387e4419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:07Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340b1cf5-83f9-4262-bbb6-7d894ad9d1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340b1cf5-83f9-4262-bbb6-7d894ad9d1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c8dfe-0211-4208-8551-c5992bc4daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c8dfe-0211-4208-8551-c5992bc4daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ff69f6-3053-4f68-9ce6-b495387e4419', 'volume_name': 'volume-70ff69f6-3053-4f68-9ce6-b495387e4419', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd25186-277a-4134-aee9-9741624d18e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd25186-277a-4134-aee9-9741624d18e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee70c910-5a24-43b1-a10a-043a3d166a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Volume 70ff69f6-3053-4f68-9ce6-b495387e4419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ff69f6-3053-4f68-9ce6-b495387e4419', 'volume_size': 1} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.295s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911229610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ff69f6-3053-4f68-9ce6-b495387e4419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:07Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Creating volume 70ff69f6-3053-4f68-9ce6-b495387e4419 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:07 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:07 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 1073741824 Jul 31 11:00:07 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7e2377-e4bf-4800-ad03-a10e5923ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f49b9a-9769-482c-805e-94a1691aacb0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4414c0e6-2636-4402-8085-b914fa58d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Volume volume-56f49b9a-9769-482c-805e-94a1691aacb0 (56f49b9a-9769-482c-805e-94a1691aacb0): created successfully Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4414c0e6-2636-4402-8085-b914fa58d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Flow 'volume_create_manager' (a9be72bf-3f9f-4828-83ae-50ca24bb6698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-310f8f6a-5d7b-491f-8774-1769236ee581 tempest-VolumesCloneTest-478569199 None] Created volume successfully. Jul 31 11:00:08 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 1073741824" returned: 0 in 0.437s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:08 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 Jul 31 11:00:08 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Flow 'volume_create_manager' (bc7593b7-c043-4d1e-bab5-5ebcae7a6482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ab9ccc-f61d-4405-ad8f-4c0a9edb4bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ab9ccc-f61d-4405-ad8f-4c0a9edb4bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1075869624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3922d7c4-eb40-48eb-be78-3c07484b37cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d9f8d8984046adaa1fd4d522b3e4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:08Z,use_quota=True,user_id='0419c4f49ef6495e82cb63c51ce912ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc9dc47-3adb-4c6f-aaee-56acc8867a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc9dc47-3adb-4c6f-aaee-56acc8867a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38862a4b-c006-4f10-b6c5-118486db8e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee70c910-5a24-43b1-a10a-043a3d166a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ff69f6-3053-4f68-9ce6-b495387e4419', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d6e0bf-da40-43f2-82ab-9c52195add5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Volume volume-70ff69f6-3053-4f68-9ce6-b495387e4419 (70ff69f6-3053-4f68-9ce6-b495387e4419): created successfully Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d6e0bf-da40-43f2-82ab-9c52195add5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (c43b31ef-3d27-4df7-933f-e36b8b0a2aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-62a622a4-7eee-4ff4-a88f-ec78ade80a72 tempest-VolumesActionsTest-894784649 None] Created volume successfully. Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38862a4b-c006-4f10-b6c5-118486db8e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3922d7c4-eb40-48eb-be78-3c07484b37cf', 'volume_name': 'volume-3922d7c4-eb40-48eb-be78-3c07484b37cf', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b8135b-eeeb-45b6-89d4-92e1e1f1c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b8135b-eeeb-45b6-89d4-92e1e1f1c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ec3107-4bc5-4025-87e4-0edd714e5d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Volume 3922d7c4-eb40-48eb-be78-3c07484b37cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3922d7c4-eb40-48eb-be78-3c07484b37cf', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Trying to clone 3922d7c4-eb40-48eb-be78-3c07484b37cf from image 054f039c-e113-4ed9-900a-f72893aac763 at location (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:00:08 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Image download 20.69 MB at 20.69 MB/s Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8fe0c-4dc3-4514-a5d5-3251301c357c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Flow 'volume_create_manager' (40e6808a-0e72-4c1a-af0b-ce0c77289006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5465843c-f098-488f-86a1-ab78a9ec8caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5465843c-f098-488f-86a1-ab78a9ec8caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-294692042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8069f92f-fa6c-4d78-bbd9-257158b1c0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='306b695fae844276a7ce4fe2653e4df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=56f49b9a-9769-482c-805e-94a1691aacb0,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:09Z,use_quota=True,user_id='0f61fed28a624db197edbcfd419f20f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32d54c0-56c2-494b-8cb1-96aa7193f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32d54c0-56c2-494b-8cb1-96aa7193f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a18b7f-150b-4aa3-934e-21d382344cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:09 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD Jul 31 11:00:09 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a18b7f-150b-4aa3-934e-21d382344cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8069f92f-fa6c-4d78-bbd9-257158b1c0bf', 'volume_name': 'volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf', 'volume_size': 2, 'source_volid': '56f49b9a-9769-482c-805e-94a1691aacb0', 'source_volstatus': 'available'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43897129-d783-4d8c-b39e-38226e20a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43897129-d783-4d8c-b39e-38226e20a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0839037f-a915-45fa-8eeb-e5bca86fe954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Volume 8069f92f-fa6c-4d78-bbd9-257158b1c0bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf', 'volume_size': 2, 'source_volid': '56f49b9a-9769-482c-805e-94a1691aacb0', 'source_volstatus': 'available'} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:09 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Cloning volume 56f49b9a-9769-482c-805e-94a1691aacb0 to volume 8069f92f-fa6c-4d78-bbd9-257158b1c0bf Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Creating offline snapshot 42a08a71-2afb-4024-97de-dbbd1bbf47e7 of volume 56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4632c5-0f28-48db-97d0-f73fbdce19fb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:09 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 is fetched for user 0419c4f49ef6495e82cb63c51ce912ae. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48c0751-3e62-4efd-96ae-6ae0dc2c859c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD Jul 31 11:00:09 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-70ff69f6-3053-4f68-9ce6-b495387e4419-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Lock "cinder-70ff69f6-3053-4f68-9ce6-b495387e4419-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Acquiring lock "cinder-quobyte-70ff69f6-3053-4f68-9ce6-b495387e4419" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-70ff69f6-3053-4f68-9ce6-b495387e4419" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:09 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.526s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81f4aef-a256-48c4-a311-ab2c93edf663]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:09 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 1G Jul 31 11:00:09 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 Jul 31 11:00:09 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:09 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:10 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 1G" returned: 0 in 0.454s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f49b9a-9769-482c-805e-94a1691aacb0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419 Jul 31 11:00:10 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f49b9a-9769-482c-805e-94a1691aacb0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 Jul 31 11:00:10 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-70ff69f6-3053-4f68-9ce6-b495387e4419" returned: 0 in 0.254s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Lock "cinder-quobyte-70ff69f6-3053-4f68-9ce6-b495387e4419" released by "delete_volume" :: held 0.713s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Created reservations ['6b3306b1-9103-4a38-ac3c-d65fb51b6933', '34db9f2e-72d3-47c8-bf36-fe6f7ca775aa', '8f671dc4-95d1-4946-9370-4c175e5b1b6f', 'c8a1b90f-0d16-4e1d-8606-386eaa467d6d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:10 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56f49b9a-9769-482c-805e-94a1691aacb0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7" returned: 0 in 0.325s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 is being set with open permissions: ugo+rw Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 Jul 31 11:00:10 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:10 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:10 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info Jul 31 11:00:10 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:10 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Deleted volume successfully. Jul 31 11:00:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bf6d252-6fa2-4693-9dfb-2ca4c6f91e5b tempest-VolumesActionsTest-1890865667 None] Lock "cinder-70ff69f6-3053-4f68-9ce6-b495387e4419-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:11 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info" returned: 0 in 0.274s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info is being set with open permissions: ugo+rw Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info Jul 31 11:00:11 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (41043591-6867-436f-a2ea-5335ba434add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c50f4a-09ec-4661-97b2-46ac5cf5743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:11 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c50f4a-09ec-4661-97b2-46ac5cf5743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-128736404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e8895b-a68d-40fe-9778-817a0cff5c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:11Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044da728-638d-425b-b8b6-a9e3fb80df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044da728-638d-425b-b8b6-a9e3fb80df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a164f71e-2c0e-458a-8a41-4cb1e2c04691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a164f71e-2c0e-458a-8a41-4cb1e2c04691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e8895b-a68d-40fe-9778-817a0cff5c4f', 'volume_name': 'volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2692d145-7003-4c83-972e-4113d24b586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2692d145-7003-4c83-972e-4113d24b586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ab363-5995-442f-bd5a-6e99817521ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:11 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Volume a1e8895b-a68d-40fe-9778-817a0cff5c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f', 'volume_size': 1} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.info" returned: 0 in 0.300s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Acquiring lock "cinder-quobyte-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] snapshot: 42a08a71-2afb-4024-97de-dbbd1bbf47e7, volume: 8069f92f-fa6c-4d78-bbd9-257158b1c0bf, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d14cc9-ebe4-44b0-b119-ee582a851c1d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 Jul 31 11:00:11 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:11 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7" returned: 0 in 0.352s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56f49b9a-9769-482c-805e-94a1691aacb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00b99f-bcc0-4afa-a473-566b597b9ba2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:11 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:11 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:12 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.344s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:12 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:00:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:12 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf Jul 31 11:00:12 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:16 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" returned: 0 in 4.762s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34db13-594b-44f6-8837-757e0ff98d14]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:17 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:17 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Flow 'volume_create_manager' (d1c2992d-0397-4c28-932e-aac6eb42183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00234c48-ffad-4701-b099-0ec86b579ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00234c48-ffad-4701-b099-0ec86b579ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1219892738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4cf34f-75b6-436d-a524-ae47997629a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1474e6e8334a91a979fb254d87a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:17Z,use_quota=True,user_id='8cc49c3232bb44a6b1021306c736884b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20621fc6-eba1-4131-a72d-4a412ace6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20621fc6-eba1-4131-a72d-4a412ace6f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e59e804-855d-494d-a4a5-dae39d127f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e59e804-855d-494d-a4a5-dae39d127f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4cf34f-75b6-436d-a524-ae47997629a9', 'volume_name': 'volume-df4cf34f-75b6-436d-a524-ae47997629a9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cbb3d0-134f-4f3d-85e8-75c4b3b0ca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cbb3d0-134f-4f3d-85e8-75c4b3b0ca92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b7810f-df0e-4c63-b6c6-480745a2f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:17 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Volume df4cf34f-75b6-436d-a524-ae47997629a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4cf34f-75b6-436d-a524-ae47997629a9', 'volume_size': 1} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:17 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.560s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:00:17 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Converted 1024.00 MB image at 214.97 MB/s Jul 31 11:00:17 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf is being set with open permissions: ugo+rw Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:17 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf Jul 31 11:00:17 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:17 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" returned: 0 in 0.240s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" released by "_copy_volume_from_snapshot" :: held 6.338s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Acquiring lock "cinder-quobyte-42a08a71-2afb-4024-97de-dbbd1bbf47e7" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-42a08a71-2afb-4024-97de-dbbd1bbf47e7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Deleting offline snapshot 42a08a71-2afb-4024-97de-dbbd1bbf47e7 of volume 56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] snapshot_file for this snap is: volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[85960446-78a7-4342-85d2-74990145ec7a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:17 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 Jul 31 11:00:17 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56f49b9a-9769-482c-805e-94a1691aacb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6791cc96-0e03-4853-b5f9-a7c2651b893a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:18 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.371s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 Jul 31 11:00:18 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:18 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7" returned: 0 in 0.359s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:18 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7 Jul 31 11:00:18 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:19 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0.42a08a71-2afb-4024-97de-dbbd1bbf47e7" returned: 0 in 0.270s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-42a08a71-2afb-4024-97de-dbbd1bbf47e7" released by "_delete_snapshot" :: held 1.438s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.137s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.383s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1075869624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3922d7c4-eb40-48eb-be78-3c07484b37cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d9f8d8984046adaa1fd4d522b3e4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:08Z,use_quota=True,user_id='0419c4f49ef6495e82cb63c51ce912ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Creating volume 3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:19 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:19 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 1073741824 Jul 31 11:00:19 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0839037f-a915-45fa-8eeb-e5bca86fe954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf', 'volume_size': 2, 'source_volid': '56f49b9a-9769-482c-805e-94a1691aacb0', 'source_volstatus': 'available'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a4825-b3b2-4bda-bb27-907213b18aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:19 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Volume volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf (8069f92f-fa6c-4d78-bbd9-257158b1c0bf): created successfully Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a4825-b3b2-4bda-bb27-907213b18aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Flow 'volume_create_manager' (40e6808a-0e72-4c1a-af0b-ce0c77289006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-87c4e3c6-f5ad-4f7f-afaa-f0a642c5d6ad tempest-VolumesCloneTest-478569199 None] Created volume successfully. Jul 31 11:00:19 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 1073741824" returned: 0 in 0.430s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:19 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:19 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 0 in 0.270s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.628s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-128736404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e8895b-a68d-40fe-9778-817a0cff5c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a9631dd3d2454bbe2a1a808117f14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:11Z,use_quota=True,user_id='08e336707c55482f8293eda6c31b43a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Creating volume a1e8895b-a68d-40fe-9778-817a0cff5c4f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:20 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f 1073741824 Jul 31 11:00:20 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Attempting download of 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 3922d7c4-eb40-48eb-be78-3c07484b37cf. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Acquiring lock "cinder-8069f92f-fa6c-4d78-bbd9-257158b1c0bf-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Lock "cinder-8069f92f-fa6c-4d78-bbd9-257158b1c0bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576005c-00ed-4b6b-ae53-5dd793d8d35b]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Acquiring lock "cinder-quobyte-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f4c52b-549c-43f8-8a14-366cd69715be]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200 Jul 31 11:00:20 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf Jul 31 11:00:20 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f 1073741824" returned: 0 in 0.542s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200" returned: 0 in 0.400s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f Jul 31 11:00:20 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" returned: 0 in 0.420s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200 Jul 31 11:00:20 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf Jul 31 11:00:20 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f" returned: 0 in 0.272s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1219892738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4cf34f-75b6-436d-a524-ae47997629a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1474e6e8334a91a979fb254d87a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:17Z,use_quota=True,user_id='8cc49c3232bb44a6b1021306c736884b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Creating volume df4cf34f-75b6-436d-a524-ae47997629a9 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:20 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:20 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 1073741824 Jul 31 11:00:20 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ab363-5995-442f-bd5a-6e99817521ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01f0267-f3d9-466e-b255-7d6e3d9b9556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:20 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Volume volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f (a1e8895b-a68d-40fe-9778-817a0cff5c4f): created successfully Jul 31 11:00:20 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01f0267-f3d9-466e-b255-7d6e3d9b9556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Flow 'volume_create_manager' (41043591-6867-436f-a2ea-5335ba434add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200" returned: 1 in 0.390s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_lzrzg200' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f40926d-0096-46e4-a9c9-09ea9c102f4f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" returned: 0 in 0.287s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d9712ebc-0dc4-44d2-99cb-f7a818ed005b tempest-VolumesActionsTest-894784649 None] Created volume successfully. Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-8069f92f-fa6c-4d78-bbd9-257158b1c0bf" released by "delete_volume" :: held 0.771s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Created reservations ['95c78a19-e273-44a3-8c25-95b7de107eca', '1a52e6ed-65f5-4b16-86a9-ed0e21f5b87d', '1ecae8f6-c419-49ea-9193-0d2cff02d236', 'c4f44629-79e7-4544-8e9f-474fd83c0704'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:21 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD Jul 31 11:00:21 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:21 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Acquiring lock "cinder-56f49b9a-9769-482c-805e-94a1691aacb0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Lock "cinder-56f49b9a-9769-482c-805e-94a1691aacb0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:21 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD" returned: 0 in 0.553s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] 054f039c-e113-4ed9-900a-f72893aac763 was qcow2, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:21 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 1073741824" returned: 0 in 0.709s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Acquiring lock "cinder-quobyte-56f49b9a-9769-482c-805e-94a1691aacb0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-56f49b9a-9769-482c-805e-94a1691aacb0" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:21 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.475s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Deleted volume successfully. Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae24ac7-a6ea-476f-aeb0-00a727884269]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:21 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 Jul 31 11:00:21 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-502efbf3-2be9-4e38-a4a0-f1a782abdaae tempest-VolumesCloneTest-478569199 None] Lock "cinder-8069f92f-fa6c-4d78-bbd9-257158b1c0bf-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:21 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:21 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:22 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9" returned: 0 in 0.308s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b7810f-df0e-4c63-b6c6-480745a2f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4cf34f-75b6-436d-a524-ae47997629a9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4229da-eaff-498c-9dd4-ad875a1c8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Acquiring lock "cinder-a1e8895b-a68d-40fe-9778-817a0cff5c4f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:22 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Volume volume-df4cf34f-75b6-436d-a524-ae47997629a9 (df4cf34f-75b6-436d-a524-ae47997629a9): created successfully Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4229da-eaff-498c-9dd4-ad875a1c8a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Flow 'volume_create_manager' (d1c2992d-0397-4c28-932e-aac6eb42183b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Lock "cinder-a1e8895b-a68d-40fe-9778-817a0cff5c4f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7a889dce-f4ee-4d1d-b357-fe75930fd8ba tempest-AttachVolumeTestJSON-1810948255 None] Created volume successfully. Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Acquiring lock "cinder-quobyte-a1e8895b-a68d-40fe-9778-817a0cff5c4f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Lock "cinder-quobyte-a1e8895b-a68d-40fe-9778-817a0cff5c4f" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[726b4b52-9118-4702-b703-afc63f718f9e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.531s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0 Jul 31 11:00:22 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:22 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f Jul 31 11:00:22 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:22 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-56f49b9a-9769-482c-805e-94a1691aacb0" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Lock "cinder-quobyte-56f49b9a-9769-482c-805e-94a1691aacb0" released by "delete_volume" :: held 0.974s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Created reservations ['d5468354-6d0a-4539-af39-cca49428f239', '540562d7-c68a-4b8c-ad51-8c8fab2d79b5', '9d7b6751-d318-4b4a-870d-09ad4e0998fb', '9095bb8d-acb8-4b5e-ad1c-050763a593e8'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:22 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f" returned: 0 in 0.505s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f Jul 31 11:00:22 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:22 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:22 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a1e8895b-a68d-40fe-9778-817a0cff5c4f" returned: 0 in 0.361s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Lock "cinder-quobyte-a1e8895b-a68d-40fe-9778-817a0cff5c4f" released by "delete_volume" :: held 0.926s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:23 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.391s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Created reservations ['bcd53f25-0723-40f2-a070-9d277fb779f0', 'ea26bc69-1919-41d2-b33b-a7a991e3dbb8', 'bd228b54-52aa-4d2b-bbe3-aee6fef3c3f3', '43163cff-ab54-45a3-a3fc-da4325ec52fd'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Deleted volume successfully. Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-42adfaeb-eac3-4596-9b91-00d439cc0c6b tempest-VolumesCloneTest-478569199 None] Lock "cinder-56f49b9a-9769-482c-805e-94a1691aacb0-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:23 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 0 in 2.011s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_3rq2gws5devstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:00:23 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Converted 112.00 MB image at 55.67 MB/s Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 1G Jul 31 11:00:23 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Deleted volume successfully. Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e0418-be63-4fda-9ce5-552e3a847b35]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d7f2f4b-5b73-42db-8f06-55f5752b1608 tempest-VolumesActionsTest-894784649 None] Lock "cinder-a1e8895b-a68d-40fe-9778-817a0cff5c4f-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:23 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 Jul 31 11:00:23 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:23 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 1G" returned: 0 in 0.332s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1150dd4-bfc0-4900-b2f6-c91be439b6dd]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:24 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9" returned: 0 in 0.392s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.423s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-df4cf34f-75b6-436d-a524-ae47997629a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec56a1d5-3e16-46b8-ae1d-6c1e2ee5c031', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:00:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-be2c6975-a10c-4350-90fa-fb1dd2af8199 req-24384bd2-8c41-4e0a-96bd-35278dd632b2 tempest-AttachVolumeTestJSON-1810948255 None] attachment_update completed successfully. Jul 31 11:00:24 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 0 in 0.470s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:24 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:24 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:24 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 1 in 0.525s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Downloaded image 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 3922d7c4-eb40-48eb-be78-3c07484b37cf successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 for user 0419c4f49ef6495e82cb63c51ce912ae is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Marking volume 3922d7c4-eb40-48eb-be78-3c07484b37cf as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Copying metadata from image 054f039c-e113-4ed9-900a-f72893aac763 to 3922d7c4-eb40-48eb-be78-3c07484b37cf. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:00:24 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Creating volume glance metadata for volume 3922d7c4-eb40-48eb-be78-3c07484b37cf backed by image 054f039c-e113-4ed9-900a-f72893aac763 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ec3107-4bc5-4025-87e4-0edd714e5d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3922d7c4-eb40-48eb-be78-3c07484b37cf', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4340862-3d5d-4545-a85a-302e4aced05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:25 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Volume volume-3922d7c4-eb40-48eb-be78-3c07484b37cf (3922d7c4-eb40-48eb-be78-3c07484b37cf): created successfully Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4340862-3d5d-4545-a85a-302e4aced05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Flow 'volume_create_manager' (bc7593b7-c043-4d1e-bab5-5ebcae7a6482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:25 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e37bf8e9-3395-4f40-8b71-e003a61da709 tempest-VolumesExtendTest-1627993165 None] Created volume successfully. Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5f4d9f-fc2c-45bc-9d9d-38de7ae872fa]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:26 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:26 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 0 in 0.568s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Flow 'volume_create_manager' (4a8cf9c1-4b06-4638-b45c-1946dd843878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e4c368-01cb-4ddb-a6ea-94abb30e0a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e4c368-01cb-4ddb-a6ea-94abb30e0a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1425583148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b596feb2-c5ab-4d45-af76-70213b0b94d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1474e6e8334a91a979fb254d87a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:27Z,use_quota=True,user_id='8cc49c3232bb44a6b1021306c736884b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87a3a1e-874c-4c08-8daa-483a4832d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87a3a1e-874c-4c08-8daa-483a4832d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4320a995-dbcc-4884-8cc1-5e32b71ffb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4320a995-dbcc-4884-8cc1-5e32b71ffb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b596feb2-c5ab-4d45-af76-70213b0b94d6', 'volume_name': 'volume-b596feb2-c5ab-4d45-af76-70213b0b94d6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87659cc5-6b80-4ff4-9327-d4052f318cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87659cc5-6b80-4ff4-9327-d4052f318cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d35486-ba7b-4e93-85de-0a3275099fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Volume b596feb2-c5ab-4d45-af76-70213b0b94d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b596feb2-c5ab-4d45-af76-70213b0b94d6', 'volume_size': 1} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:26 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 1 in 0.411s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 2G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf 2G" returned: 0 in 0.085s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.147s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1425583148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b596feb2-c5ab-4d45-af76-70213b0b94d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1474e6e8334a91a979fb254d87a10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:27Z,use_quota=True,user_id='8cc49c3232bb44a6b1021306c736884b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Creating volume b596feb2-c5ab-4d45-af76-70213b0b94d6 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:27 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 1073741824 Jul 31 11:00:27 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-cf2b45fa-3359-48da-87cf-5b49a14b7c16 tempest-VolumesExtendTest-1627993165 None] Extend volume completed successfully. Jul 31 11:00:27 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 1073741824" returned: 0 in 0.562s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:27 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 Jul 31 11:00:27 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:27 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6" returned: 0 in 0.318s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d35486-ba7b-4e93-85de-0a3275099fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b596feb2-c5ab-4d45-af76-70213b0b94d6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7f2e0d-b0cb-4a0f-9849-122178725d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Volume volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 (b596feb2-c5ab-4d45-af76-70213b0b94d6): created successfully Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7f2e0d-b0cb-4a0f-9849-122178725d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Flow 'volume_create_manager' (4a8cf9c1-4b06-4638-b45c-1946dd843878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-45acb609-7ec1-4f20-971a-e22fc0fa15bd tempest-AttachVolumeTestJSON-1810948255 None] Created volume successfully. Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Flow 'volume_create_manager' (e6b4f8ea-2b69-4153-9676-ac47be752813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20a275f-ab4a-4b9b-bdf4-96f47cda402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20a275f-ab4a-4b9b-bdf4-96f47cda402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-92249375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66313a4-a420-43e7-b975-98374ebb9b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b11d0a4441144bdeafa5a55647d16da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:28Z,use_quota=True,user_id='4830b1b246af47278cede3c5471bb4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c45935-f2ea-404d-988a-490d6e7d9e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c45935-f2ea-404d-988a-490d6e7d9e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64669c63-5164-4bab-a622-1e3a74964d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64669c63-5164-4bab-a622-1e3a74964d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66313a4-a420-43e7-b975-98374ebb9b53', 'volume_name': 'volume-d66313a4-a420-43e7-b975-98374ebb9b53', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d03b0da-90d4-4da9-91c4-c9bf6138a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d03b0da-90d4-4da9-91c4-c9bf6138a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40953ae5-5cdf-4595-9933-e8dd15011de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Volume d66313a4-a420-43e7-b975-98374ebb9b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66313a4-a420-43e7-b975-98374ebb9b53', 'volume_size': 1} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-92249375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66313a4-a420-43e7-b975-98374ebb9b53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b11d0a4441144bdeafa5a55647d16da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:28Z,use_quota=True,user_id='4830b1b246af47278cede3c5471bb4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Creating volume d66313a4-a420-43e7-b975-98374ebb9b53 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:28 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 1073741824 Jul 31 11:00:28 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-3922d7c4-eb40-48eb-be78-3c07484b37cf-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Lock "cinder-3922d7c4-eb40-48eb-be78-3c07484b37cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-quobyte-3922d7c4-eb40-48eb-be78-3c07484b37cf" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-3922d7c4-eb40-48eb-be78-3c07484b37cf" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf02fda-d3d1-4d72-a036-7694b62991aa]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:28 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:28 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 1073741824" returned: 0 in 0.599s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:28 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 Jul 31 11:00:28 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 0 in 0.579s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53" returned: 0 in 0.396s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40953ae5-5cdf-4595-9933-e8dd15011de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66313a4-a420-43e7-b975-98374ebb9b53', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620dc47c-bfbe-4d40-889a-1496fd16bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=101,cinder:UPDATE=129,cinder:DELETE=8,cinder:INSERT=37 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:00:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Volume volume-d66313a4-a420-43e7-b975-98374ebb9b53 (d66313a4-a420-43e7-b975-98374ebb9b53): created successfully Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620dc47c-bfbe-4d40-889a-1496fd16bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:29 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:29 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Flow 'volume_create_manager' (e6b4f8ea-2b69-4153-9676-ac47be752813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=95,cinder:UPDATE=117,cinder:INSERT=31,cinder:DELETE=13 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:00:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c5dc85c3-966e-4bb2-b0f0-a77da3f37104 tempest-VolumesListTestJSON-73777469 None] Created volume successfully. Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4080daaa-b633-49cc-8a07-9ebb1b224d0a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 1 in 0.463s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:29 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf Jul 31 11:00:29 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 Jul 31 11:00:29 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:29 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3922d7c4-eb40-48eb-be78-3c07484b37cf" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-3922d7c4-eb40-48eb-be78-3c07484b37cf" released by "delete_volume" :: held 1.402s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Created reservations ['da24631e-f335-485a-975f-13e269feaff5', '869149f9-03a5-41f2-a6fc-2a5af368e606', 'b1b0a414-bbda-4427-8329-c7eb6fbdd9f8', '5429ef80-34b2-4f15-9158-61f34adaee26'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:30 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6" returned: 0 in 0.386s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.407s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-b596feb2-c5ab-4d45-af76-70213b0b94d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e00ef2e-b33d-4ffa-bfe6-b697cc61ae4b', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:30 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:30 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-73ad9014-401b-4f70-ae0e-48ecc8df632f req-634732a0-d21b-45a2-a491-c7dd3555628e tempest-AttachVolumeTestJSON-1810948255 None] attachment_update completed successfully. Jul 31 11:00:30 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Deleted volume successfully. Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-02ed6a6c-3e4d-4ee2-94d0-95020777dfe5 tempest-VolumesExtendTest-1627993165 None] Lock "cinder-3922d7c4-eb40-48eb-be78-3c07484b37cf-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Flow 'volume_create_manager' (b8ef0fc4-65a4-4a0f-84e7-526107f73ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2342f720-3ad7-4f8b-b426-8568fad532f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2342f720-3ad7-4f8b-b426-8568fad532f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1571543414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f598a1-de74-4117-ad57-1de732b3b0e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b11d0a4441144bdeafa5a55647d16da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:31Z,use_quota=True,user_id='4830b1b246af47278cede3c5471bb4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2a43ee-1991-4672-9e4b-df6f076f92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2a43ee-1991-4672-9e4b-df6f076f92a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0a0004-0be6-4dfb-8934-252d1d7626c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0a0004-0be6-4dfb-8934-252d1d7626c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f598a1-de74-4117-ad57-1de732b3b0e2', 'volume_name': 'volume-b9f598a1-de74-4117-ad57-1de732b3b0e2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85df1167-b37f-470f-b261-a69aa6df1bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85df1167-b37f-470f-b261-a69aa6df1bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990cda6c-4f93-4880-a038-9634605b088c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Volume b9f598a1-de74-4117-ad57-1de732b3b0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f598a1-de74-4117-ad57-1de732b3b0e2', 'volume_size': 1} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1571543414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f598a1-de74-4117-ad57-1de732b3b0e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b11d0a4441144bdeafa5a55647d16da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:31Z,use_quota=True,user_id='4830b1b246af47278cede3c5471bb4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Creating volume b9f598a1-de74-4117-ad57-1de732b3b0e2 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:31 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 1073741824 Jul 31 11:00:31 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Flow 'volume_create_manager' (beebd01a-a625-452f-b9b2-ae88108e0c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4dc5f4-df51-4b29-b199-98086e3bbee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4dc5f4-df51-4b29-b199-98086e3bbee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1461848724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915765f2-e7c8-4744-af82-9626e825c383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d9f8d8984046adaa1fd4d522b3e4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:31Z,use_quota=True,user_id='0419c4f49ef6495e82cb63c51ce912ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5351a07e-f5c8-4dc1-a4bb-c8dbe7aeaf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5351a07e-f5c8-4dc1-a4bb-c8dbe7aeaf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8201abae-5ea9-4b06-aeb2-eed668e5f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8201abae-5ea9-4b06-aeb2-eed668e5f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915765f2-e7c8-4744-af82-9626e825c383', 'volume_name': 'volume-915765f2-e7c8-4744-af82-9626e825c383', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea25628c-a4b5-423d-bf50-9a95e93ebd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea25628c-a4b5-423d-bf50-9a95e93ebd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cba9026-ec23-49c1-88dd-98dd325998f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Volume 915765f2-e7c8-4744-af82-9626e825c383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915765f2-e7c8-4744-af82-9626e825c383', 'volume_size': 1} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:31 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 1073741824" returned: 0 in 0.569s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 Jul 31 11:00:31 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:31 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2" returned: 0 in 0.279s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1461848724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915765f2-e7c8-4744-af82-9626e825c383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d9f8d8984046adaa1fd4d522b3e4c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:31Z,use_quota=True,user_id='0419c4f49ef6495e82cb63c51ce912ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Creating volume 915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:31 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990cda6c-4f93-4880-a038-9634605b088c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f598a1-de74-4117-ad57-1de732b3b0e2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 1073741824 Jul 31 11:00:31 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0d3761-8ae2-417d-aef7-a8cfd471b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:31 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Volume volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 (b9f598a1-de74-4117-ad57-1de732b3b0e2): created successfully Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0d3761-8ae2-417d-aef7-a8cfd471b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Flow 'volume_create_manager' (b8ef0fc4-65a4-4a0f-84e7-526107f73ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e54c2b63-9384-458f-b1ae-5be74cea134b tempest-VolumesListTestJSON-73777469 None] Created volume successfully. Jul 31 11:00:32 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 1073741824" returned: 0 in 0.500s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:32 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 Jul 31 11:00:32 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-94680fc2-5e23-4c89-8a72-407ed037dfe9 req-ecc24a5b-616a-4f8a-9bc5-c8ed05d9c01f tempest-AttachVolumeTestJSON-1810948255 None] Terminate volume connection completed successfully. Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-94680fc2-5e23-4c89-8a72-407ed037dfe9 req-ecc24a5b-616a-4f8a-9bc5-c8ed05d9c01f tempest-AttachVolumeTestJSON-1810948255 None] Deleting attachment ec56a1d5-3e16-46b8-ae1d-6c1e2ee5c031. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:00:32 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383" returned: 0 in 0.304s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cba9026-ec23-49c1-88dd-98dd325998f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915765f2-e7c8-4744-af82-9626e825c383', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d5f719-9796-46cd-bdae-18350565fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:32 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Volume volume-915765f2-e7c8-4744-af82-9626e825c383 (915765f2-e7c8-4744-af82-9626e825c383): created successfully Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d5f719-9796-46cd-bdae-18350565fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Flow 'volume_create_manager' (beebd01a-a625-452f-b9b2-ae88108e0c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5d1f1472-6039-4adf-a94d-77b7be18865f tempest-VolumesExtendTest-1627993165 None] Created volume successfully. Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Flow 'volume_create_manager' (f9555e2a-6a13-496b-8f60-43b91e6271ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f8dc7f-3283-493f-9f97-61fcba964d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f8dc7f-3283-493f-9f97-61fcba964d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-795069603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eefe989-1aab-49a6-9966-c0a272195788,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b11d0a4441144bdeafa5a55647d16da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:34Z,use_quota=True,user_id='4830b1b246af47278cede3c5471bb4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448c5036-a831-4e93-ac5a-299b7d8a0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448c5036-a831-4e93-ac5a-299b7d8a0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a50df7-e766-4423-af5c-68b113885423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a50df7-e766-4423-af5c-68b113885423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eefe989-1aab-49a6-9966-c0a272195788', 'volume_name': 'volume-3eefe989-1aab-49a6-9966-c0a272195788', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66205377-a918-4b65-891c-58dae627c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66205377-a918-4b65-891c-58dae627c72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78829967-b881-4e09-8510-7dbe2bb0b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:33 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Volume 3eefe989-1aab-49a6-9966-c0a272195788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eefe989-1aab-49a6-9966-c0a272195788', 'volume_size': 1} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-795069603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eefe989-1aab-49a6-9966-c0a272195788,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b11d0a4441144bdeafa5a55647d16da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:34Z,use_quota=True,user_id='4830b1b246af47278cede3c5471bb4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Creating volume 3eefe989-1aab-49a6-9966-c0a272195788 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:33 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:33 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 1073741824 Jul 31 11:00:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:33 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:34 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 1073741824" returned: 0 in 0.601s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:34 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 Jul 31 11:00:34 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:34 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-cc1a977d-17ba-48e1-8f20-56f2e473f736 req-a0cd77b5-4fe8-4312-b05a-6418d53f95f1 tempest-AttachVolumeTestJSON-1810948255 None] Terminate volume connection completed successfully. Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-cc1a977d-17ba-48e1-8f20-56f2e473f736 req-a0cd77b5-4fe8-4312-b05a-6418d53f95f1 tempest-AttachVolumeTestJSON-1810948255 None] Deleting attachment 8e00ef2e-b33d-4ffa-bfe6-b697cc61ae4b. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:00:34 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.889s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78829967-b881-4e09-8510-7dbe2bb0b045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eefe989-1aab-49a6-9966-c0a272195788', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdde6bc6-585f-49f9-bc7e-e8bf7ae84f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Creating offline snapshot 9c48ecc7-512e-4e2e-97de-92f11b578130 of volume 915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Volume volume-3eefe989-1aab-49a6-9966-c0a272195788 (3eefe989-1aab-49a6-9966-c0a272195788): created successfully Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdde6bc6-585f-49f9-bc7e-e8bf7ae84f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Flow 'volume_create_manager' (f9555e2a-6a13-496b-8f60-43b91e6271ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb5dc24-a7a5-46e3-9109-d86497e0aec3]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:34 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c437c8fa-e910-4a9b-843c-0328aa103648 tempest-VolumesListTestJSON-73777469 None] Created volume successfully. Jul 31 11:00:34 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 Jul 31 11:00:34 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:35 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383" returned: 0 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:35 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 1G Jul 31 11:00:35 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:35 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 1G" returned: 0 in 0.621s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915765f2-e7c8-4744-af82-9626e825c383 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:35 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915765f2-e7c8-4744-af82-9626e825c383 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 Jul 31 11:00:35 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-915765f2-e7c8-4744-af82-9626e825c383 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130" returned: 0 in 0.527s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:36 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 is being set with open permissions: ugo+rw Jul 31 11:00:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:36 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 Jul 31 11:00:36 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:36 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130" returned: 0 in 0.366s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:36 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info Jul 31 11:00:36 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:37 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info" returned: 0 in 0.383s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:37 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info is being set with open permissions: ugo+rw Jul 31 11:00:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:37 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info Jul 31 11:00:37 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:37 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.info" returned: 0 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3163a505-ff12-4829-a6f4-f778d092ce26 tempest-VolumesExtendTest-1627993165 None] Create snapshot completed successfully Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d6fe72-acd8-48af-96cf-30b70f155027]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:38 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 Jul 31 11:00:38 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:38 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383" returned: 0 in 0.575s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 2G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "cinder-3eefe989-1aab-49a6-9966-c0a272195788-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-3eefe989-1aab-49a6-9966-c0a272195788-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "cinder-quobyte-3eefe989-1aab-49a6-9966-c0a272195788" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-quobyte-3eefe989-1aab-49a6-9966-c0a272195788" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470a9ae-6b48-4353-a63a-5b98372a8cf0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 2G" returned: 0 in 0.260s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.893s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-05ede970-0baa-4cab-ae86-5fc7d5e9b75d tempest-VolumesExtendTest-1627993165 None] Extend volume completed successfully. Jul 31 11:00:39 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 Jul 31 11:00:39 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-9c48ecc7-512e-4e2e-97de-92f11b578130-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-9c48ecc7-512e-4e2e-97de-92f11b578130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-quobyte-915765f2-e7c8-4744-af82-9626e825c383" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-915765f2-e7c8-4744-af82-9626e825c383" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-quobyte-9c48ecc7-512e-4e2e-97de-92f11b578130" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:39 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788" returned: 0 in 0.522s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-9c48ecc7-512e-4e2e-97de-92f11b578130" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Deleting offline snapshot 9c48ecc7-512e-4e2e-97de-92f11b578130 of volume 915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:39 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788 Jul 31 11:00:39 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] snapshot_file for this snap is: volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae83f45d-cf3b-48b8-ab57-ca8fb3c6b30a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:39 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 Jul 31 11:00:39 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:39 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3eefe989-1aab-49a6-9966-c0a272195788" returned: 0 in 0.329s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-quobyte-3eefe989-1aab-49a6-9966-c0a272195788" released by "delete_volume" :: held 0.910s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Created reservations ['24c49d15-a006-4aef-8372-4747f1efd1ba', 'bc7fe829-021d-47a8-9d87-dafe8f743e40', '61ba5abf-2835-4aad-9012-bd8e6ad2644d', '85ea7448-f320-4781-8b91-73a08ecb1c83'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:40 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130" returned: 0 in 0.511s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-915765f2-e7c8-4744-af82-9626e825c383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51575a-844e-47db-857c-80cc45163055]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "cinder-b9f598a1-de74-4117-ad57-1de732b3b0e2-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-b9f598a1-de74-4117-ad57-1de732b3b0e2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "cinder-quobyte-b9f598a1-de74-4117-ad57-1de732b3b0e2" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-quobyte-b9f598a1-de74-4117-ad57-1de732b3b0e2" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:40 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 Jul 31 11:00:40 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.366s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb8f1d5-ec5b-4944-a467-61a59a38713e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Deleted volume successfully. Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f61338f9-9471-464c-a02e-c0d03a173cd9 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-3eefe989-1aab-49a6-9966-c0a272195788-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:40 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 Jul 31 11:00:40 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 Jul 31 11:00:40 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:40 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2" returned: 0 in 0.503s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:40 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2 Jul 31 11:00:40 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "cinder-b596feb2-c5ab-4d45-af76-70213b0b94d6-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-b596feb2-c5ab-4d45-af76-70213b0b94d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "cinder-quobyte-b596feb2-c5ab-4d45-af76-70213b0b94d6" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-quobyte-b596feb2-c5ab-4d45-af76-70213b0b94d6" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:41 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b4c7b-2442-4fd0-a597-b0ed1bd151a9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130" returned: 0 in 0.550s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b9f598a1-de74-4117-ad57-1de732b3b0e2" returned: 0 in 0.331s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130 Jul 31 11:00:41 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-quobyte-b9f598a1-de74-4117-ad57-1de732b3b0e2" released by "delete_volume" :: held 0.913s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:41 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 Jul 31 11:00:41 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Created reservations ['4c04f1f1-7e3e-4773-bf84-73d1b3d521a1', '59bd87e1-f8cc-46de-b739-16b39261693e', '77f9da41-ea5a-4a09-9623-a0d9784dd04e', 'd6e9bb91-c3c3-411e-88de-6ed8648058ab'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:41 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383.9c48ecc7-512e-4e2e-97de-92f11b578130" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-9c48ecc7-512e-4e2e-97de-92f11b578130" released by "_delete_snapshot" :: held 2.069s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-915765f2-e7c8-4744-af82-9626e825c383" released by "delete_snapshot" :: held 2.106s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:41 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6" returned: 0 in 0.461s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:41 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6 Jul 31 11:00:41 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Created reservations ['db98899d-df4b-46ae-8e03-7dad075685a2', '5a90da50-09c2-4b02-a25b-d834df713e67', '4a89d75e-d345-4948-be80-a8810da59d32', 'c3835363-954c-4591-a7f5-5863146ae0eb'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Delete snapshot completed successfully. Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2d95810-0804-44c7-924c-c42a4b82fa5f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-9c48ecc7-512e-4e2e-97de-92f11b578130-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:41 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Deleted volume successfully. Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2ab26a41-7cf1-4871-aa2d-4965e2694392 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-b9f598a1-de74-4117-ad57-1de732b3b0e2-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:41 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b596feb2-c5ab-4d45-af76-70213b0b94d6" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-quobyte-b596feb2-c5ab-4d45-af76-70213b0b94d6" released by "delete_volume" :: held 0.798s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Created reservations ['9c805bb5-d8a5-4c85-ac18-30410c5c43a8', 'dc902da8-8f9a-48c0-bd53-3be6842e48c3', '2a6a91a5-4adc-4780-a677-3f16d9d5cc42', 'dcc530e1-3f18-43ed-9a08-1f7a03f9992a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:42 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "cinder-df4cf34f-75b6-436d-a524-ae47997629a9-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-df4cf34f-75b6-436d-a524-ae47997629a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "cinder-quobyte-df4cf34f-75b6-436d-a524-ae47997629a9" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-quobyte-df4cf34f-75b6-436d-a524-ae47997629a9" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd19a9-32ab-44ed-91d8-91b2c77f5fc7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.308s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Deleted volume successfully. Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b1ac5aae-fa2f-4c0c-a837-c754ccaae4fb tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-b596feb2-c5ab-4d45-af76-70213b0b94d6-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:42 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 Jul 31 11:00:42 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "cinder-d66313a4-a420-43e7-b975-98374ebb9b53-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-d66313a4-a420-43e7-b975-98374ebb9b53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "cinder-quobyte-d66313a4-a420-43e7-b975-98374ebb9b53" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-quobyte-d66313a4-a420-43e7-b975-98374ebb9b53" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dddb9fd-08ee-4bfd-936d-2a2fabbc11e7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-915765f2-e7c8-4744-af82-9626e825c383-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:42 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Flow 'volume_create_manager' (effe2fa3-1fa2-404a-b1f1-d34af20e8775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962d0ca6-42e9-43c2-88da-1b1b059dd09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-915765f2-e7c8-4744-af82-9626e825c383-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9" returned: 0 in 0.556s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 Jul 31 11:00:42 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9 Jul 31 11:00:42 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962d0ca6-42e9-43c2-88da-1b1b059dd09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-245720481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dafe07-1446-4f0c-a46c-8c1cf11bb1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5b21cb5931425296ad19e8c74931c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:43Z,use_quota=True,user_id='e41a8b9005534fbd8f90c46e1876c668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:42 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afab1bd-ab98-4339-b5ae-33f24e5a07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afab1bd-ab98-4339-b5ae-33f24e5a07bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602c2b2e-af43-4e2b-a974-f1ac753c02cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602c2b2e-af43-4e2b-a974-f1ac753c02cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65dafe07-1446-4f0c-a46c-8c1cf11bb1c9', 'volume_name': 'volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9b8392-c54f-47ce-856a-307f7e3006c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9b8392-c54f-47ce-856a-307f7e3006c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4555a6e-ba04-474a-9a42-5788c0f1b804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:42 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Volume 65dafe07-1446-4f0c-a46c-8c1cf11bb1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9', 'volume_size': 1} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-245720481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65dafe07-1446-4f0c-a46c-8c1cf11bb1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5b21cb5931425296ad19e8c74931c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:43Z,use_quota=True,user_id='e41a8b9005534fbd8f90c46e1876c668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Creating volume 65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:42 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:42 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 1073741824 Jul 31 11:00:42 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "cinder-quobyte-915765f2-e7c8-4744-af82-9626e825c383" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-915765f2-e7c8-4744-af82-9626e825c383" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8deb0-1f39-4ad2-aafe-39fc330f4c29]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-df4cf34f-75b6-436d-a524-ae47997629a9" returned: 0 in 0.279s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-quobyte-df4cf34f-75b6-436d-a524-ae47997629a9" released by "delete_volume" :: held 0.888s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:43 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 Jul 31 11:00:43 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53" returned: 0 in 0.487s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53 Jul 31 11:00:43 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Created reservations ['5c1796ac-6bfe-45e1-b25b-2ba3fe32ba85', 'd7f3dae2-0670-4267-b88a-99afc28b4912', '6bcc5ec0-d950-41dd-acdd-c434cd2adb4a', '8afefccf-8368-4172-9b70-2ae2b1eeab7d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:43 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 1073741824" returned: 0 in 0.585s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383" returned: 0 in 0.519s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d66313a4-a420-43e7-b975-98374ebb9b53" returned: 0 in 0.368s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383 Jul 31 11:00:43 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "cinder-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-quobyte-d66313a4-a420-43e7-b975-98374ebb9b53" released by "delete_volume" :: held 0.937s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:43 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:43 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "cinder-quobyte-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-quobyte-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a10f902-14fc-4da8-abbb-46a0a74e405f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Created reservations ['ec674d5c-9818-4e51-b6e2-c0c332c3866c', '31781d4b-dcd3-4a07-a92e-0393df05ea00', '5fd8df0b-3cc2-4d1e-a8b2-98905d0e746c', 'e2956cf6-169e-4913-8b3c-a692019e765a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:43 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.429s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Deleted volume successfully. Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f263062-0d8e-44ce-a695-be820d82735a tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-df4cf34f-75b6-436d-a524-ae47997629a9-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:43 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-915765f2-e7c8-4744-af82-9626e825c383" returned: 0 in 0.408s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 Jul 31 11:00:44 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:44 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-quobyte-915765f2-e7c8-4744-af82-9626e825c383" released by "delete_volume" :: held 0.997s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:44 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.371s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4555a6e-ba04-474a-9a42-5788c0f1b804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a35d12b-7eb4-4200-9e7b-476eeb372b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Volume volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 (65dafe07-1446-4f0c-a46c-8c1cf11bb1c9): created successfully Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a35d12b-7eb4-4200-9e7b-476eeb372b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Flow 'volume_create_manager' (effe2fa3-1fa2-404a-b1f1-d34af20e8775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-038f6493-1864-46e1-aa3d-060800d4ea7f tempest-VolumesDeleteCascade-351672556 None] Created volume successfully. Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Created reservations ['e34fcd63-007e-4914-abab-0414e9c75260', '81915745-e5d9-43f3-ad02-e61301dd8216', '0987ae49-31ab-4c41-af5f-c71885811168', 'b1714da6-472b-4893-8885-2932ef2c08f1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:44 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.294s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Deleted volume successfully. Jul 31 11:00:44 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" returned: 0 in 0.483s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fc153d7c-63f7-4b24-9a4e-b82985f878c8 tempest-VolumesListTestJSON-73777469 None] Lock "cinder-d66313a4-a420-43e7-b975-98374ebb9b53-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:44 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0 Jul 31 11:00:44 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.276s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Deleted volume successfully. Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8527fd1a-ea27-470a-b79c-a849fb40804f tempest-VolumesExtendTest-1627993165 None] Lock "cinder-915765f2-e7c8-4744-af82-9626e825c383-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:44 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" returned: 0 in 0.254s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-quobyte-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0" released by "delete_volume" :: held 0.807s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Created reservations ['a92d4ea4-bf3d-430c-ab71-8f002536bcef', '584c8c1e-d99a-4f48-bd3e-0630c92ef925', '320cd2f8-6760-4cad-8f18-19998ee0d4bd', '9115145e-da71-46fb-b100-fc38eddb30b8'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:44 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:44 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:44 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Deleted volume successfully. Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-11ed4d5c-0334-482a-9fae-1e50e414bc43 tempest-AttachVolumeTestJSON-1810948255 None] Lock "cinder-ea44f41c-cc4a-4fe2-94b8-fa5c848da8a0-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Creating offline snapshot 10e50116-b928-4ab1-8495-53793133e5d9 of volume 65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d459e66-519a-4c5f-8c9f-a272e3f47671]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:45 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:45 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:45 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.470s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:45 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 1G Jul 31 11:00:45 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 1G" returned: 0 in 0.462s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:46 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 is being set with open permissions: ugo+rw Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:46 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:46 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.321s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:46 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info Jul 31 11:00:46 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:46 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:00:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:00:47 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info" returned: 0 in 0.333s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:47 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info is being set with open permissions: ugo+rw Jul 31 11:00:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:47 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info Jul 31 11:00:47 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:47 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.info" returned: 0 in 0.298s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-069cf71a-1098-4488-90ea-4fbf3d04c883 tempest-VolumesDeleteCascade-351672556 None] Create snapshot completed successfully Jul 31 11:00:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Creating offline snapshot 25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 of volume 65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020def1-1e98-4a40-8518-0e874b96cc33]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:48 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:48 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:49 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.472s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:49 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 1G Jul 31 11:00:49 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Flow 'volume_create_manager' (8ea89aa8-b8a9-4dba-8ad7-37785118bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a4e80c-3d1a-4187-8fc0-89a93eb83cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a4e80c-3d1a-4187-8fc0-89a93eb83cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-159156996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e009f887-dc53-4c74-8a7b-71917aa8b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa384b76ba24c6aa61fd8e0cc4cf20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:49Z,use_quota=True,user_id='e9900e6f51694e7e8f6c40443bd5e961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369bbdb4-b752-4e4a-896c-41d60d36577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369bbdb4-b752-4e4a-896c-41d60d36577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab092e42-f808-4b94-a004-547b13991189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab092e42-f808-4b94-a004-547b13991189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e009f887-dc53-4c74-8a7b-71917aa8b733', 'volume_name': 'volume-e009f887-dc53-4c74-8a7b-71917aa8b733', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436705d2-0011-4716-b2e4-a9f4274ee536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436705d2-0011-4716-b2e4-a9f4274ee536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233f43b9-a8db-419c-af8d-b1f9663b13b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:49 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Volume e009f887-dc53-4c74-8a7b-71917aa8b733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e009f887-dc53-4c74-8a7b-71917aa8b733', 'volume_size': 1} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:49 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 1G" returned: 0 in 0.627s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:49 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 Jul 31 11:00:49 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" returned: 0 in 0.324s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:50 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 is being set with open permissions: ugo+rw Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 Jul 31 11:00:50 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" returned: 0 in 0.299s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-159156996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e009f887-dc53-4c74-8a7b-71917aa8b733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa384b76ba24c6aa61fd8e0cc4cf20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:49Z,use_quota=True,user_id='e9900e6f51694e7e8f6c40443bd5e961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Creating volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:50 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 1073741824 Jul 31 11:00:50 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fdab5863-78da-4606-9464-7d45e22ea8a9 tempest-VolumesDeleteCascade-351672556 None] Create snapshot completed successfully Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Performing cascade delete. {{(pid=88837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-10e50116-b928-4ab1-8495-53793133e5d9-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-10e50116-b928-4ab1-8495-53793133e5d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-10e50116-b928-4ab1-8495-53793133e5d9" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-10e50116-b928-4ab1-8495-53793133e5d9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Deleting offline snapshot 10e50116-b928-4ab1-8495-53793133e5d9 of volume 65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] snapshot_file for this snap is: volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cb98f0-35ff-4eb1-b16e-2076890fda3a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:50 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 1073741824" returned: 0 in 0.607s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 Jul 31 11:00:51 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:51 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:51 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.473s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233f43b9-a8db-419c-af8d-b1f9663b13b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e009f887-dc53-4c74-8a7b-71917aa8b733', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a4fdb3-d652-49cb-92dc-5aac54eb7205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b40094-abed-4f68-aafb-73debc91da03]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:51 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Volume volume-e009f887-dc53-4c74-8a7b-71917aa8b733 (e009f887-dc53-4c74-8a7b-71917aa8b733): created successfully Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a4fdb3-d652-49cb-92dc-5aac54eb7205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Flow 'volume_create_manager' (8ea89aa8-b8a9-4dba-8ad7-37785118bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c0de7b85-0d1a-4cdf-8ff3-aaaa06f28aad tempest-VolumesSnapshotListTestJSON-557404722 None] Created volume successfully. Jul 31 11:00:51 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:51 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:51 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.424s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb9d16-7fcb-4799-b902-27a0d720595c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 Jul 31 11:00:52 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:52 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ac4a10-eb35-4185-91a2-35f1ef3be739]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:52 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Creating offline snapshot 51642f3e-bb05-4e81-b544-45845822e27e of volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f978933-d473-4795-a4ef-f5fcc0f3f7e4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.485s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bb8315-6b9e-4e9e-8293-3c7cac3dd8ac]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:52 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 Jul 31 11:00:52 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:52 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Flow 'volume_create_manager' (f1b236d6-a512-4c94-be27-15eaebaf9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:52 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8237f2ec-a9c1-4b9d-8f36-32f370b7af38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8237f2ec-a9c1-4b9d-8f36-32f370b7af38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1757092714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c407ba-0942-45d2-99b2-73b40726a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6264102f35c248abad1fc9e2c0712e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:53Z,use_quota=True,user_id='da8bc530ac3c4eab81e894906786192b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c352f72-e965-4a3b-a6fc-8d04fdd0f09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c352f72-e965-4a3b-a6fc-8d04fdd0f09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ef2463-6bce-4b74-8a79-2bd21797ba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ef2463-6bce-4b74-8a79-2bd21797ba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c407ba-0942-45d2-99b2-73b40726a14d', 'volume_name': 'volume-d3c407ba-0942-45d2-99b2-73b40726a14d', 'volume_size': 2}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712d1cda-d473-474a-ab51-4de6478afb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712d1cda-d473-474a-ab51-4de6478afb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16424c6-217b-4a38-983a-e886bd97d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Volume d3c407ba-0942-45d2-99b2-73b40726a14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c407ba-0942-45d2-99b2-73b40726a14d', 'volume_size': 2} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:53 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733" returned: 0 in 0.480s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.441s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e 1G Jul 31 11:00:53 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:53 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.395s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e 1G" returned: 0 in 0.420s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9 Jul 31 11:00:53 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:00:53 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:53 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.10e50116-b928-4ab1-8495-53793133e5d9" returned: 0 in 0.262s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 -F qcow2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:53 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 -F qcow2 Jul 31 11:00:53 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.341s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e is being set with open permissions: ugo+rw Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:00:54 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 -F qcow2" returned: 0 in 0.355s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.290s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-10e50116-b928-4ab1-8495-53793133e5d9" released by "_delete_snapshot" :: held 3.448s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" released by "delete_snapshot" :: held 3.480s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info Jul 31 11:00:54 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Created reservations ['36d72e71-dfaa-4e49-a27a-c73a7587f01c', 'f11b29a7-24ac-4e04-b75a-42b9ecfd05b9', '1429766c-9ad1-46eb-a85e-b2d2497ea6ba', '6b9f85be-fcbd-4403-a752-0a9fd225b406'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Delete snapshot completed successfully. Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-10e50116-b928-4ab1-8495-53793133e5d9-delete_snapshot" released by "delete_snapshot" :: held 3.696s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Deleting offline snapshot 25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 of volume 65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] snapshot_file for this snap is: volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e673dfcf-22a5-40e9-ba3a-ba1761affc2c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info" returned: 0 in 0.289s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info is being set with open permissions: ugo+rw Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:54 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info Jul 31 11:00:54 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 Jul 31 11:00:54 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:54 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.info" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.911s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1757092714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c407ba-0942-45d2-99b2-73b40726a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6264102f35c248abad1fc9e2c0712e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:53Z,use_quota=True,user_id='da8bc530ac3c4eab81e894906786192b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Creating volume d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:00:55 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d 2147483648 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d 2147483648 Jul 31 11:00:55 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8d4da84c-c69d-4e40-b7e6-f54f2c92050f tempest-VolumesSnapshotListTestJSON-557404722 None] Create snapshot completed successfully Jul 31 11:00:55 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" returned: 0 in 0.475s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9410417-4000-41cf-8a76-8a0648eb4151]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:55 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.401s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 Jul 31 11:00:55 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d 2147483648" returned: 0 in 0.603s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d Jul 31 11:00:55 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" returned: 0 in 0.386s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:55 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:55 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7 Jul 31 11:00:55 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16424c6-217b-4a38-983a-e886bd97d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c407ba-0942-45d2-99b2-73b40726a14d', 'volume_size': 2}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cac16c-cae6-4182-862e-c5ddc46c7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Volume volume-d3c407ba-0942-45d2-99b2-73b40726a14d (d3c407ba-0942-45d2-99b2-73b40726a14d): created successfully Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45cac16c-cae6-4182-862e-c5ddc46c7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Flow 'volume_create_manager' (f1b236d6-a512-4c94-be27-15eaebaf9520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4597682f-3761-4ff0-8e85-be59c9c49f10 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Created volume successfully. Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Creating offline snapshot 0fd93d65-a341-4b9d-9ac7-d430ab2c06db of volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3428404f-06fe-4bcc-9da0-daee840fe56c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9.25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" returned: 0 in 0.365s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7" released by "_delete_snapshot" :: held 1.733s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" released by "delete_snapshot" :: held 1.759s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:56 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:00:56 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Created reservations ['eae4e925-42f7-43ce-a4c9-ac8100f8a319', '42ba346a-36af-420e-a381-3e4ae35b354a', '16d6dc61-3386-4ad9-a057-35a8eacfe8e3', 'a760a0f4-8632-4033-b8ce-dc8ac782190f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Delete snapshot completed successfully. Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-25bb8b6c-21fb-4f8e-b3bd-7e57ed9c0fa7-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Snapshots deleted, issuing volume delete {{(pid=88837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f89f5-2946-4d1c-80bb-9007a5612821]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.385s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db 1G Jul 31 11:00:56 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:56 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:56 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:56 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.393s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:56 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9 Jul 31 11:00:56 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db 1G" returned: 0 in 0.543s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:00:57 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-593cd9df-147d-4b8b-8d03-5e4742eea82d tempest-BackendsCapabilitiesAdminTestsJSON-1981103429 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5441589355469, 'free_capacity_gb': 1775.5441589355469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88837) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 11:00:57 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" returned: 0 in 0.331s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-cbc98dab-418b-4596-8065-07c644e4f7c9 tempest-BackendsCapabilitiesAdminTestsJSON-1981103429 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5441589355469, 'free_capacity_gb': 1775.5441589355469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88837) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9" released by "delete_volume" :: held 0.817s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Created reservations ['6bed72e4-0c63-46ca-803b-b70d43b88ae4', '8275fa3d-2f3f-4b12-a563-ec59bd7373e4', 'c85696c3-ab12-4d99-bdf2-47a866a32d74', 'e8a74cb5-7547-4e15-b870-cfa181824ee3'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:00:57 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.441s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db is being set with open permissions: ugo+rw Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:57 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:00:57 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:57 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.286s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:00:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Deleted volume successfully. Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f856c118-c987-4322-b9c9-9afe0ed336e9 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-65dafe07-1446-4f0c-a46c-8c1cf11bb1c9-delete_volume" released by "delete_volume" :: held 7.112s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:00:57 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.259s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.753s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.463s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Creating offline snapshot 61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 of volume d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:00:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f6a610be-94ab-4408-b94d-67c06b9270aa tempest-VolumesSnapshotListTestJSON-557404722 None] Create snapshot completed successfully Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[837baa03-8e7f-44de-991f-2b532c7f927d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:00:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d Jul 31 11:00:58 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 2G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 2G Jul 31 11:00:58 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:58 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 2G" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c407ba-0942-45d2-99b2-73b40726a14d -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:58 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c407ba-0942-45d2-99b2-73b40726a14d -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 Jul 31 11:00:58 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Flow 'volume_create_manager' (a05b0f14-c093-4447-860a-d6f276798f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89cdc2e-d2bd-4d89-bffb-59d468fec96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89cdc2e-d2bd-4d89-bffb-59d468fec96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1576372852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90288c5e-54fa-4580-8ef3-1379b9bb5e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5b21cb5931425296ad19e8c74931c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:59Z,use_quota=True,user_id='e41a8b9005534fbd8f90c46e1876c668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b62e50-2a2d-4e2d-8cc2-5e6098facb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:59 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b62e50-2a2d-4e2d-8cc2-5e6098facb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36d43a1-f494-4e4b-917b-599a32c2b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36d43a1-f494-4e4b-917b-599a32c2b618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90288c5e-54fa-4580-8ef3-1379b9bb5e16', 'volume_name': 'volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb92bb42-1e75-4e9c-bf7c-226d2f2aabae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb92bb42-1e75-4e9c-bf7c-226d2f2aabae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba879ab1-09a2-40ea-a479-da3488d439ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:00:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Volume 90288c5e-54fa-4580-8ef3-1379b9bb5e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16', 'volume_size': 1} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3c407ba-0942-45d2-99b2-73b40726a14d -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" returned: 0 in 0.416s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:59 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 is being set with open permissions: ugo+rw Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 Jul 31 11:00:59 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" returned: 0 in 0.274s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info Jul 31 11:00:59 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:00:59 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:00:59 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info is being set with open permissions: ugo+rw Jul 31 11:00:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:00:59 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info Jul 31 11:00:59 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.info" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.685s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Creating offline snapshot db1aee7e-0ed7-43ff-9c6e-37fc7f793507 of volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:00 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9e866238-b96c-4e6c-9c21-48950a87b949 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Create snapshot completed successfully Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[970eb99d-f3c6-4e27-8a0e-0569c69b5a2b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:01:00 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.395s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:00 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 1G Jul 31 11:01:00 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "cinder-61e73473-49e4-44aa-b5d0-d1b2f6baa6e7-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-61e73473-49e4-44aa-b5d0-d1b2f6baa6e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "cinder-quobyte-d3c407ba-0942-45d2-99b2-73b40726a14d" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-quobyte-d3c407ba-0942-45d2-99b2-73b40726a14d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "cinder-quobyte-61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-quobyte-61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Deleting offline snapshot 61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 of volume d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] snapshot_file for this snap is: volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66c1a9-57ff-4b42-9538-a4330a3f17bc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 Jul 31 11:01:01 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 1G" returned: 0 in 0.527s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 Jul 31 11:01:01 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3c407ba-0942-45d2-99b2-73b40726a14d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[175e9c73-9261-4d6c-8ffc-11b5b4a432b4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507" returned: 0 in 0.328s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 is being set with open permissions: ugo+rw Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d Jul 31 11:01:01 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 Jul 31 11:01:01 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507" returned: 0 in 0.257s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.651s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.543s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1576372852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90288c5e-54fa-4580-8ef3-1379b9bb5e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5b21cb5931425296ad19e8c74931c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:00:59Z,use_quota=True,user_id='e41a8b9005534fbd8f90c46e1876c668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Creating volume 90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:01 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d" returned: 0 in 0.439s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:01 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 1073741824 Jul 31 11:01:01 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 Jul 31 11:01:01 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f1e56ab5-5955-4180-97c2-c7b29ab6674e tempest-VolumesSnapshotListTestJSON-557404722 None] Create snapshot completed successfully Jul 31 11:01:02 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:02 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7 Jul 31 11:01:02 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:02 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 1073741824" returned: 0 in 0.533s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:02 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:02 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:02 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d.61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" returned: 0 in 0.297s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-quobyte-61e73473-49e4-44aa-b5d0-d1b2f6baa6e7" released by "_delete_snapshot" :: held 1.676s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-quobyte-d3c407ba-0942-45d2-99b2-73b40726a14d" released by "delete_snapshot" :: held 1.704s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Created reservations ['46154e02-faa9-4f3c-811d-59c479125567', '8a57147f-f8d7-4538-b2bb-4ae0cc6925bb', 'd7708d43-3ee0-4258-985c-0feeacd76801', '29dc3651-e5de-46a1-9972-4571a71a819d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:02 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.315s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba879ab1-09a2-40ea-a479-da3488d439ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8edbce6-1ce0-49ec-a3b4-67621c3536d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:02 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Volume volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 (90288c5e-54fa-4580-8ef3-1379b9bb5e16): created successfully Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8edbce6-1ce0-49ec-a3b4-67621c3536d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Flow 'volume_create_manager' (a05b0f14-c093-4447-860a-d6f276798f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-83a37401-a06c-4ef6-aad2-d6174bf7d80f tempest-VolumesDeleteCascade-351672556 None] Created volume successfully. Jul 31 11:01:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Delete snapshot completed successfully. Jul 31 11:01:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4c222b8a-bcb4-4882-8352-081a55893555 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-61e73473-49e4-44aa-b5d0-d1b2f6baa6e7-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "cinder-d3c407ba-0942-45d2-99b2-73b40726a14d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-d3c407ba-0942-45d2-99b2-73b40726a14d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "cinder-quobyte-d3c407ba-0942-45d2-99b2-73b40726a14d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-quobyte-d3c407ba-0942-45d2-99b2-73b40726a14d" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a53dc39-b177-4eab-874c-c7176c78a941]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:03 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d Jul 31 11:01:03 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Creating offline snapshot 303572d5-d5d1-4005-a3cf-7ed9314a69c1 of volume 90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-db1aee7e-0ed7-43ff-9c6e-37fc7f793507-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34d176-a8ed-4d7f-a146-1afdb951e5fa]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-db1aee7e-0ed7-43ff-9c6e-37fc7f793507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-db1aee7e-0ed7-43ff-9c6e-37fc7f793507" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-db1aee7e-0ed7-43ff-9c6e-37fc7f793507" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Deleting offline snapshot db1aee7e-0ed7-43ff-9c6e-37fc7f793507 of volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] snapshot_file for this snap is: volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[85123e84-c0fa-44e6-a674-b41d59d54ce1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:03 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:03 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:03 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d" returned: 0 in 0.606s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 Jul 31 11:01:04 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d Jul 31 11:01:04 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.428s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 1G Jul 31 11:01:04 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d3c407ba-0942-45d2-99b2-73b40726a14d" returned: 0 in 0.339s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507" returned: 0 in 0.518s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-quobyte-d3c407ba-0942-45d2-99b2-73b40726a14d" released by "delete_volume" :: held 1.086s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7149f8-0ab3-460b-8f11-e7ce685b0ef5]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Created reservations ['89e92240-7387-4cbe-a248-7c9f505fd475', '9e49e541-618a-46bf-abd9-eb3e4aeb1a7c', 'be8ce94f-eeb9-491e-b22e-70c9e23db8c4', 'efa1a92e-074b-47ff-9aa9-33b31bdc0543'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:01:04 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:04 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 1G" returned: 0 in 0.646s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 Jul 31 11:01:04 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:04 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.369s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Deleted volume successfully. Jul 31 11:01:04 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.546s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5244671e-a84b-467c-852b-bad4c0cc3c07 tempest-VolumesSnapshotNegativeTestJSON-334582320 None] Lock "cinder-d3c407ba-0942-45d2-99b2-73b40726a14d-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:04 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 Jul 31 11:01:04 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1" returned: 0 in 0.387s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 is being set with open permissions: ugo+rw Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:05 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 Jul 31 11:01:05 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507" returned: 0 in 0.545s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:05 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1" returned: 0 in 0.319s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507 Jul 31 11:01:05 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:05 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info Jul 31 11:01:05 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.db1aee7e-0ed7-43ff-9c6e-37fc7f793507" returned: 0 in 0.384s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-db1aee7e-0ed7-43ff-9c6e-37fc7f793507" released by "_delete_snapshot" :: held 2.118s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:05 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info" returned: 0 in 0.355s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:05 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info is being set with open permissions: ugo+rw Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" released by "delete_snapshot" :: held 2.157s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:05 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info Jul 31 11:01:05 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:05 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Created reservations ['4fe7db02-b03f-4b79-8db2-9011dfff8359', '76e2605c-ce52-4f04-aef3-9d0d84e5e909', 'eaff1eac-f22c-4668-a58f-f101903033b9', '30e6dde5-1490-4b0e-876b-b44be2b6840e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Delete snapshot completed successfully. Jul 31 11:01:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-347610fe-e288-4858-b164-a5300d40995f tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-db1aee7e-0ed7-43ff-9c6e-37fc7f793507-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:06 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.info" returned: 0 in 0.383s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.637s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-232c3cce-ff6d-48f3-9a00-a7d81fad35ad tempest-VolumesDeleteCascade-351672556 None] Create snapshot completed successfully Jul 31 11:01:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-0fd93d65-a341-4b9d-9ac7-d430ab2c06db-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-0fd93d65-a341-4b9d-9ac7-d430ab2c06db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-0fd93d65-a341-4b9d-9ac7-d430ab2c06db" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-0fd93d65-a341-4b9d-9ac7-d430ab2c06db" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Deleting offline snapshot 0fd93d65-a341-4b9d-9ac7-d430ab2c06db of volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] snapshot_file for this snap is: volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d56fb6-027f-4615-a618-ee025a753a08]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:07 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:01:07 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Flow 'volume_create_manager' (e5a3bb85-a974-4b0f-8a75-9c909f24a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5430b3f0-49fa-41b8-9b9e-9a5f4421244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5430b3f0-49fa-41b8-9b9e-9a5f4421244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1040246661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a7c1fd-6e0f-415d-b642-92a405405ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5b21cb5931425296ad19e8c74931c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=303572d5-d5d1-4005-a3cf-7ed9314a69c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:07Z,use_quota=True,user_id='e41a8b9005534fbd8f90c46e1876c668',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb62c09-d142-414f-ad32-0ae2087fad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb62c09-d142-414f-ad32-0ae2087fad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb56603-c197-4e0d-8fa6-292dd589431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb56603-c197-4e0d-8fa6-292dd589431f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03a7c1fd-6e0f-415d-b642-92a405405ec4', 'volume_name': 'volume-03a7c1fd-6e0f-415d-b642-92a405405ec4', 'volume_size': 1, 'snapshot_id': '303572d5-d5d1-4005-a3cf-7ed9314a69c1'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a937b2-d8a7-45d7-8acc-8cdabc991a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a937b2-d8a7-45d7-8acc-8cdabc991a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34008e64-64d8-45dd-b86a-ae98b5174ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Volume 03a7c1fd-6e0f-415d-b642-92a405405ec4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03a7c1fd-6e0f-415d-b642-92a405405ec4', 'volume_size': 1, 'snapshot_id': '303572d5-d5d1-4005-a3cf-7ed9314a69c1'} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.649s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-303572d5-d5d1-4005-a3cf-7ed9314a69c1-03a7c1fd-6e0f-415d-b642-92a405405ec4" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dedc04-176f-4d37-8bf2-61c7c5026186]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-303572d5-d5d1-4005-a3cf-7ed9314a69c1-03a7c1fd-6e0f-415d-b642-92a405405ec4" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Creating volume 03a7c1fd-6e0f-415d-b642-92a405405ec4 from snapshot 303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-03a7c1fd-6e0f-415d-b642-92a405405ec4" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-03a7c1fd-6e0f-415d-b642-92a405405ec4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] snapshot: 303572d5-d5d1-4005-a3cf-7ed9314a69c1, volume: 03a7c1fd-6e0f-415d-b642-92a405405ec4, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[91829cdd-a4a1-490c-bf8c-3a8839cfb409]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:07 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:01:07 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 Jul 31 11:01:08 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.477s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:01:08 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1" returned: 0 in 0.497s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2beb19-a641-4706-abd3-869b563e3605]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:08 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.455s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db Jul 31 11:01:08 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:08 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.462s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:01:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:08 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 Jul 31 11:01:08 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:09 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.0fd93d65-a341-4b9d-9ac7-d430ab2c06db" returned: 0 in 0.347s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-0fd93d65-a341-4b9d-9ac7-d430ab2c06db" released by "_delete_snapshot" :: held 2.076s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" released by "delete_snapshot" :: held 2.110s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:09 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Created reservations ['7d10ea65-0afe-4f3f-9e13-a77e3122f645', '0068ecc8-7beb-4885-bb24-3f88e95aabc6', '9e7d05a9-3fd7-4b0b-b59c-e42dbca41724', 'b68d695b-1123-4b12-b206-7cc52452f557'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c5afb3de-da07-4793-bb35-6a9b6160eb2b tempest-GroupsV320Test-1618680760 None] Group tempest-GroupsV320Test-Group-776274126: creating Jul 31 11:01:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c5afb3de-da07-4793-bb35-6a9b6160eb2b tempest-GroupsV320Test-1618680760 None] Group tempest-GroupsV320Test-Group-776274126: created successfully Jul 31 11:01:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Delete snapshot completed successfully. Jul 31 11:01:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c5afb3de-da07-4793-bb35-6a9b6160eb2b tempest-GroupsV320Test-1618680760 None] Create group completed successfully. Jul 31 11:01:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba50f320-3c7e-4daa-adbf-3ef174df1b35 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-0fd93d65-a341-4b9d-9ac7-d430ab2c06db-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-51642f3e-bb05-4e81-b544-45845822e27e-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-51642f3e-bb05-4e81-b544-45845822e27e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" acquired by "delete_snapshot" :: waited 0.064s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-51642f3e-bb05-4e81-b544-45845822e27e" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-51642f3e-bb05-4e81-b544-45845822e27e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Deleting offline snapshot 51642f3e-bb05-4e81-b544-45845822e27e of volume e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] snapshot_file for this snap is: volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc99c6-19ba-4d15-92db-75d77b675db2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:10 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:01:10 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:11 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.844s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e009f887-dc53-4c74-8a7b-71917aa8b733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11166a0-cd7d-4f3b-89c2-d366929146f1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Created reservations ['90233c0b-b64e-4ced-afc3-6e5fc9d849e3'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:11 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 Jul 31 11:01:11 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:12 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733" returned: 0 in 1.037s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:12 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.738s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:12 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:12 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:01:12 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:12 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-737b3705-e544-4b99-9745-63d2cc28963d tempest-GroupsV320Test-1618680760 None] Delete group completed successfully. Jul 31 11:01:13 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.776s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:13 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e Jul 31 11:01:13 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:13 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733.51642f3e-bb05-4e81-b544-45845822e27e" returned: 0 in 0.419s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-51642f3e-bb05-4e81-b544-45845822e27e" released by "_delete_snapshot" :: held 3.412s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" released by "delete_snapshot" :: held 3.481s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Created reservations ['8689fd2a-0c6c-494e-b66e-7349b959513b', 'aed11259-241d-40bd-91ee-17e3e411ded5', '54ccafe5-b55a-4aad-a7fb-8735638b4c5f', '33ebb2fb-5fff-4d71-9e26-28943d238022'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Delete snapshot completed successfully. Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cee74faf-264c-4e38-ab8d-b3abea634b11 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-51642f3e-bb05-4e81-b544-45845822e27e-delete_snapshot" released by "delete_snapshot" :: held 4.035s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:14 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4" returned: 0 in 5.963s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c2566-8281-4fc8-8f2a-ca0061959140]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-e009f887-dc53-4c74-8a7b-71917aa8b733-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-e009f887-dc53-4c74-8a7b-71917aa8b733-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:15 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:15 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c0139c-9624-4c87-beca-faf33ca0d2bc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:15 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 Jul 31 11:01:15 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:15 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.749s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:01:15 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Converted 1024.00 MB image at 171.68 MB/s Jul 31 11:01:15 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 is being set with open permissions: ugo+rw Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:15 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733" returned: 0 in 0.503s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:15 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 Jul 31 11:01:15 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:15 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733 Jul 31 11:01:15 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:15 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4" returned: 0 in 0.323s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-03a7c1fd-6e0f-415d-b642-92a405405ec4" released by "_copy_volume_from_snapshot" :: held 8.117s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-303572d5-d5d1-4005-a3cf-7ed9314a69c1-03a7c1fd-6e0f-415d-b642-92a405405ec4" released by "_create_volume_from_snapshot" :: held 8.149s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.177s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:16 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34008e64-64d8-45dd-b86a-ae98b5174ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a7c1fd-6e0f-415d-b642-92a405405ec4', 'volume_size': 1, 'snapshot_id': '303572d5-d5d1-4005-a3cf-7ed9314a69c1'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fc065c-ac75-4311-b89a-6e25114929e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e009f887-dc53-4c74-8a7b-71917aa8b733" returned: 0 in 0.364s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-quobyte-e009f887-dc53-4c74-8a7b-71917aa8b733" released by "delete_volume" :: held 0.985s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:16 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Volume volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 (03a7c1fd-6e0f-415d-b642-92a405405ec4): created successfully Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fc065c-ac75-4311-b89a-6e25114929e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Flow 'volume_create_manager' (e5a3bb85-a974-4b0f-8a75-9c909f24a94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3a911155-01aa-4738-90ee-2ead9a74f735 tempest-VolumesDeleteCascade-351672556 None] Created volume successfully. Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Created reservations ['27a82518-053d-4b3a-afea-6935f55e1c50', 'ff5b992f-2cf3-45d2-81c5-1686ac9c0236', 'd566d06c-8316-4dc9-a4b8-91a8a45adfc9', 'a54bffb8-87ff-45ba-a4c0-e628c97563d8'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:16 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:16 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:16 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.297s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Deleted volume successfully. Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0cae214-3216-450f-919c-fc5bd16c9fd6 tempest-VolumesSnapshotListTestJSON-557404722 None] Lock "cinder-e009f887-dc53-4c74-8a7b-71917aa8b733-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-90288c5e-54fa-4580-8ef3-1379b9bb5e16-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-90288c5e-54fa-4580-8ef3-1379b9bb5e16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Performing cascade delete. {{(pid=88837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-303572d5-d5d1-4005-a3cf-7ed9314a69c1-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-303572d5-d5d1-4005-a3cf-7ed9314a69c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-90288c5e-54fa-4580-8ef3-1379b9bb5e16" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-90288c5e-54fa-4580-8ef3-1379b9bb5e16" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-303572d5-d5d1-4005-a3cf-7ed9314a69c1" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-303572d5-d5d1-4005-a3cf-7ed9314a69c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Deleting offline snapshot 303572d5-d5d1-4005-a3cf-7ed9314a69c1 of volume 90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] snapshot_file for this snap is: volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a421f4c-116e-41f0-b110-3e24f8e0f2a8]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:16 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 Jul 31 11:01:16 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:17 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:01:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5ea38-d411-4256-9264-af73ea2f3c2d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:17 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:17 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:17 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.620s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:17 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 Jul 31 11:01:17 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:18 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1" returned: 0 in 0.580s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:18 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1 Jul 31 11:01:18 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:18 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16.303572d5-d5d1-4005-a3cf-7ed9314a69c1" returned: 0 in 0.321s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-303572d5-d5d1-4005-a3cf-7ed9314a69c1" released by "_delete_snapshot" :: held 2.125s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-90288c5e-54fa-4580-8ef3-1379b9bb5e16" released by "delete_snapshot" :: held 2.154s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Created reservations ['879e9e5c-7300-4d04-89e9-9c6815d8114b', 'e8d685f2-d5b5-4165-8a70-73d5de52e289', '853d415b-f6d7-4c8b-9507-1e5bc8c93728', '05ea7f76-0b8e-46e6-a5c4-f2431072024d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Delete snapshot completed successfully. Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-303572d5-d5d1-4005-a3cf-7ed9314a69c1-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Snapshots deleted, issuing volume delete {{(pid=88837) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-90288c5e-54fa-4580-8ef3-1379b9bb5e16" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-90288c5e-54fa-4580-8ef3-1379b9bb5e16" acquired by "delete_volume" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf9c329-c773-4e8d-a201-6fae2d48017f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:19 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:19 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:19 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.518s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:19 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16 Jul 31 11:01:19 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:20 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-90288c5e-54fa-4580-8ef3-1379b9bb5e16" returned: 0 in 0.358s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-90288c5e-54fa-4580-8ef3-1379b9bb5e16" released by "delete_volume" :: held 0.983s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Created reservations ['9234c9e5-3f20-499d-a269-b2375220accf', '59f00fbb-f9e2-4e0e-8909-41be89f4f9a5', 'd23de091-dd56-47fe-9766-facad49db8b6', '59f8328d-4d34-46e2-a28b-cb4113c13daa'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:20 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:20 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:20 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.371s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:20 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Deleted volume successfully. Jul 31 11:01:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1aa01395-50de-4a33-9560-708552bf2f7f tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-90288c5e-54fa-4580-8ef3-1379b9bb5e16-delete_volume" released by "delete_volume" :: held 4.230s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-03a7c1fd-6e0f-415d-b642-92a405405ec4-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-03a7c1fd-6e0f-415d-b642-92a405405ec4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "cinder-quobyte-03a7c1fd-6e0f-415d-b642-92a405405ec4" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-03a7c1fd-6e0f-415d-b642-92a405405ec4" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2260e6-0f0f-4d21-9ae4-80dad2f8e215]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:21 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 Jul 31 11:01:21 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:22 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4" returned: 0 in 0.489s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:22 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4 Jul 31 11:01:22 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:22 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-03a7c1fd-6e0f-415d-b642-92a405405ec4" returned: 0 in 0.288s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-quobyte-03a7c1fd-6e0f-415d-b642-92a405405ec4" released by "delete_volume" :: held 0.841s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Created reservations ['c8756c3f-98c3-4605-8ce6-0758691d5487', '0bda535c-1abb-4de6-a7f7-d89c1255a045', 'f1792db3-6c08-4aca-97f8-56b7af373fe4', 'db5bc3a5-363b-42b7-acce-c551cddd1c00'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:22 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:22 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:22 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.355s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Deleted volume successfully. Jul 31 11:01:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fff9fec0-4dde-407a-b31b-addd5ee77681 tempest-VolumesDeleteCascade-351672556 None] Lock "cinder-03a7c1fd-6e0f-415d-b642-92a405405ec4-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=193,cinder:INSERT=49,cinder:UPDATE=181,cinder:DELETE=9 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:DELETE=21,cinder:SELECT=134,cinder:INSERT=48,cinder:UPDATE=198 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Flow 'volume_create_manager' (91ee783e-afca-498f-8bea-0fe6192598ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d26c3b2-5c7f-42be-bd1e-b1f75e7e3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d26c3b2-5c7f-42be-bd1e-b1f75e7e3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1983405308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d22ad38-9e6a-448a-a5d7-7945630ef1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3aa9a92622430c9cffc7790eb22886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:30Z,use_quota=True,user_id='e58704136a8d424d81310a4e510436e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0382d240-c19c-4158-a553-c079732f9ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0382d240-c19c-4158-a553-c079732f9ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1d5f7e-30e5-4b54-92b7-177e2b3ade31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1d5f7e-30e5-4b54-92b7-177e2b3ade31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d22ad38-9e6a-448a-a5d7-7945630ef1dc', 'volume_name': 'volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f7d344-9977-4b0b-97d5-e343f64384f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f7d344-9977-4b0b-97d5-e343f64384f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0951cf64-ef0d-4de1-8914-4885ee335294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:30 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Volume 4d22ad38-9e6a-448a-a5d7-7945630ef1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc', 'volume_size': 1} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1983405308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d22ad38-9e6a-448a-a5d7-7945630ef1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3aa9a92622430c9cffc7790eb22886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:30Z,use_quota=True,user_id='e58704136a8d424d81310a4e510436e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Creating volume 4d22ad38-9e6a-448a-a5d7-7945630ef1dc {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:30 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:30 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc 1073741824 Jul 31 11:01:30 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:31 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc 1073741824" returned: 0 in 0.699s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:31 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc Jul 31 11:01:31 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:31 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc" returned: 0 in 0.406s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0951cf64-ef0d-4de1-8914-4885ee335294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f2255a-3266-4d92-a5fb-81a8ca6a717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:31 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Volume volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc (4d22ad38-9e6a-448a-a5d7-7945630ef1dc): created successfully Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f2255a-3266-4d92-a5fb-81a8ca6a717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Flow 'volume_create_manager' (91ee783e-afca-498f-8bea-0fe6192598ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:31 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0d35e06f-909e-4d0a-b70d-67c717797c53 tempest-VolumesTransfersV357Test-299186353 None] Created volume successfully. Jul 31 11:01:33 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0e39c2dc-f991-4f39-a708-cc0fe9221195 tempest-VolumesTransfersV357Test-1100441263 None] Transfer volume completed successfully. Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Flow 'volume_create_manager' (fdc4a121-0a19-406f-a094-f2de9ab8359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1657d9-30ab-41f6-847a-b6ff4bebe789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1657d9-30ab-41f6-847a-b6ff4bebe789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1165365711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985bb8f6-f125-4c50-a9dc-11259b5e15f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a3b71ad2c46c090dd3f4c788ac462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:34Z,use_quota=True,user_id='43349bc8df26452d958ddaaf85b5df9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162f62bb-c12c-458c-a957-c3fb6839a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162f62bb-c12c-458c-a957-c3fb6839a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4d8c17-579a-414a-a543-ff23a9911720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4d8c17-579a-414a-a543-ff23a9911720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985bb8f6-f125-4c50-a9dc-11259b5e15f3', 'volume_name': 'volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d57e4c-dbe5-4813-b3a9-34107df5a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d57e4c-dbe5-4813-b3a9-34107df5a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b37bed2-4e99-4c2a-b105-38e03fefea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Volume 985bb8f6-f125-4c50-a9dc-11259b5e15f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3', 'volume_size': 1} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1165365711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985bb8f6-f125-4c50-a9dc-11259b5e15f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a3b71ad2c46c090dd3f4c788ac462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:34Z,use_quota=True,user_id='43349bc8df26452d958ddaaf85b5df9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Creating volume 985bb8f6-f125-4c50-a9dc-11259b5e15f3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:34 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Acquiring lock "cinder-4d22ad38-9e6a-448a-a5d7-7945630ef1dc-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:34 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 1073741824 Jul 31 11:01:34 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-4d22ad38-9e6a-448a-a5d7-7945630ef1dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Acquiring lock "cinder-quobyte-4d22ad38-9e6a-448a-a5d7-7945630ef1dc" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-quobyte-4d22ad38-9e6a-448a-a5d7-7945630ef1dc" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2656f1f-0c45-4c41-886c-f725792f60a9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:34 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc Jul 31 11:01:34 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:35 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc" returned: 0 in 0.614s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:35 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 1073741824" returned: 0 in 0.804s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:35 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc Jul 31 11:01:35 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:35 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 Jul 31 11:01:35 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:35 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4d22ad38-9e6a-448a-a5d7-7945630ef1dc" returned: 0 in 0.315s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-quobyte-4d22ad38-9e6a-448a-a5d7-7945630ef1dc" released by "delete_volume" :: held 1.000s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:35 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b37bed2-4e99-4c2a-b105-38e03fefea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8aebfe-1173-4b99-ad3a-5f9fc5c07e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:35 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Volume volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 (985bb8f6-f125-4c50-a9dc-11259b5e15f3): created successfully Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8aebfe-1173-4b99-ad3a-5f9fc5c07e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Flow 'volume_create_manager' (fdc4a121-0a19-406f-a094-f2de9ab8359a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:35 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-54c87c3c-d3bd-4dc3-b130-b262c3fb6ad7 tempest-VolumeQuotasAdminTestJSON-198016695 None] Created volume successfully. Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Created reservations ['195c9171-560b-4ff9-888c-b3c43e21c402', '6987ac65-6b74-4e09-b1d9-595a68f030c3', '82f8bdc3-bb5f-4e9a-a060-9946b19afad1', 'b10a19c9-2354-4640-8e88-140120639d6f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:35 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:35 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:36 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.292s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Deleted volume successfully. Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0ef0b174-9955-487c-8978-e3542f40c96f tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-4d22ad38-9e6a-448a-a5d7-7945630ef1dc-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "cinder-985bb8f6-f125-4c50-a9dc-11259b5e15f3-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "cinder-985bb8f6-f125-4c50-a9dc-11259b5e15f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "cinder-quobyte-985bb8f6-f125-4c50-a9dc-11259b5e15f3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "cinder-quobyte-985bb8f6-f125-4c50-a9dc-11259b5e15f3" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f72e621-0c93-4af9-880d-82e1feff8bee]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:36 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 Jul 31 11:01:36 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:37 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3 Jul 31 11:01:37 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-985bb8f6-f125-4c50-a9dc-11259b5e15f3" returned: 0 in 0.426s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "cinder-quobyte-985bb8f6-f125-4c50-a9dc-11259b5e15f3" released by "delete_volume" :: held 0.962s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Flow 'volume_create_manager' (6a5a17de-5825-403e-922e-bcb7f035a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51000dd6-3e9a-4919-bce8-318e87d245bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Created reservations ['b01307df-ffb2-4875-9ede-e2ab1d525546', '33192aea-5923-491c-b078-d0920698f086', '26788ac6-f703-4c5a-a769-d9fded4b7804', 'ce86f2ba-9da9-4522-b315-b18feacb561c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51000dd6-3e9a-4919-bce8-318e87d245bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2130244236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3aa9a92622430c9cffc7790eb22886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:38Z,use_quota=True,user_id='e58704136a8d424d81310a4e510436e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429e54c2-f3db-4787-9e8f-dd628c50f9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429e54c2-f3db-4787-9e8f-dd628c50f9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9495f4c4-8476-4245-b9b7-5c88c9343b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9495f4c4-8476-4245-b9b7-5c88c9343b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c', 'volume_name': 'volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a02e7-d12d-42b1-8371-b1daeb1f86ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a02e7-d12d-42b1-8371-b1daeb1f86ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d222fb-a079-4c6b-ba0f-402a790eddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Volume ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c', 'volume_size': 1} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2130244236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3aa9a92622430c9cffc7790eb22886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:38Z,use_quota=True,user_id='e58704136a8d424d81310a4e510436e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Creating volume ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:37 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:37 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c 1073741824 Jul 31 11:01:37 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:37 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:37 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:38 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.540s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:38 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Deleted volume successfully. Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6abf8df4-3284-4a9b-9754-9afd6b7b5016 tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "cinder-985bb8f6-f125-4c50-a9dc-11259b5e15f3-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:38 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c 1073741824" returned: 0 in 0.723s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:38 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c Jul 31 11:01:38 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:38 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c" returned: 0 in 0.323s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d222fb-a079-4c6b-ba0f-402a790eddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aa0135-bb69-4b4b-ad78-74cb0ac7a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:38 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Volume volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c (ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c): created successfully Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04aa0135-bb69-4b4b-ad78-74cb0ac7a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Flow 'volume_create_manager' (6a5a17de-5825-403e-922e-bcb7f035a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:38 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4d5f4e7e-ca64-4229-90f7-e60ea85b3d49 tempest-VolumesTransfersV357Test-299186353 None] Created volume successfully. Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Flow 'volume_create_manager' (8f724bd6-9012-45c9-8593-e513ee42d600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d54a8ad-b3ca-430f-b947-37546739a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d54a8ad-b3ca-430f-b947-37546739a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1131233971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82026bfc-d6b1-4ef1-a8fe-4db64289d3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a3b71ad2c46c090dd3f4c788ac462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:40Z,use_quota=True,user_id='43349bc8df26452d958ddaaf85b5df9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cea4650-4639-4414-8d60-be4cc33ddcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cea4650-4639-4414-8d60-be4cc33ddcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74eb1f19-2619-4494-b763-714d1c953495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74eb1f19-2619-4494-b763-714d1c953495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82026bfc-d6b1-4ef1-a8fe-4db64289d3f9', 'volume_name': 'volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd1469a-0c78-4078-af8a-b5a3661afaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd1469a-0c78-4078-af8a-b5a3661afaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5857b1a-cacf-4d35-ad17-d4770f61557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:39 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Volume 82026bfc-d6b1-4ef1-a8fe-4db64289d3f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9', 'volume_size': 1} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1131233971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82026bfc-d6b1-4ef1-a8fe-4db64289d3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='092a3b71ad2c46c090dd3f4c788ac462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:40Z,use_quota=True,user_id='43349bc8df26452d958ddaaf85b5df9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Creating volume 82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:39 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:39 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 1073741824 Jul 31 11:01:39 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Acquiring lock "cinder-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Acquiring lock "cinder-quobyte-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-quobyte-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[477040b2-e872-41d7-995d-da580c06801d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:40 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 1073741824" returned: 0 in 0.728s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:40 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c Jul 31 11:01:40 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 Jul 31 11:01:40 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:40 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5857b1a-cacf-4d35-ad17-d4770f61557e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a5e153-6a8d-4362-bdf0-4e8983f2db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Volume volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 (82026bfc-d6b1-4ef1-a8fe-4db64289d3f9): created successfully Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a5e153-6a8d-4362-bdf0-4e8983f2db97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Flow 'volume_create_manager' (8f724bd6-9012-45c9-8593-e513ee42d600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:40 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-53aaf714-e65e-49e7-8d67-9a1b8538112d tempest-VolumeQuotasAdminTestJSON-198016695 None] Created volume successfully. Jul 31 11:01:40 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c" returned: 0 in 0.634s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c Jul 31 11:01:41 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-quobyte-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c" released by "delete_volume" :: held 1.013s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Created reservations ['8782562d-24c6-4383-b5e9-d55136c976fa', '394e6c1b-ef38-457a-a482-bfa4e483e000', '2ee96ae7-15c2-4885-a683-5991bb9a017c', '7c12946f-24ed-4ccd-bc03-28dee9cf5a68'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:41 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:41 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:41 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.340s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Deleted volume successfully. Jul 31 11:01:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cec9225e-7895-4e6c-a5e4-aedcd97b5aef tempest-VolumesTransfersV357Test-640560807 None] Lock "cinder-ab362d7b-cae6-4e0f-a1a8-a4f898d7d83c-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6c9e8c97-299e-49c8-92b4-2886e0444ff0 tempest-VolumeQuotasAdminTestJSON-1433750614 None] Transfer volume completed successfully. Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Acquiring lock "cinder-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Lock "cinder-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Acquiring lock "cinder-quobyte-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Lock "cinder-quobyte-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad03e088-9acc-49c2-926c-c29d29a3a7df]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:43 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 Jul 31 11:01:43 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:43 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9" returned: 0 in 0.537s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:44 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9 Jul 31 11:01:44 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:44 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9" returned: 0 in 0.390s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Lock "cinder-quobyte-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9" released by "delete_volume" :: held 0.984s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Created reservations ['aef36363-7d48-4a0a-82d8-035524661abb', '52f0dcec-82ad-42d4-8715-047273b0b6a6', '5fee18a7-2be3-4aa8-8062-5b4cc46fa010', 'e98ac6a5-767c-4dd4-99d4-cf34175d7167'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:44 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:44 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:44 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.327s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Deleted volume successfully. Jul 31 11:01:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4a3b2ae6-72ab-406e-bc2b-14d31fcc5f6e tempest-VolumeQuotasAdminTestJSON-1391123758 None] Lock "cinder-82026bfc-d6b1-4ef1-a8fe-4db64289d3f9-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:46 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:46 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.619s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:47 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Flow 'volume_create_manager' (c22315d0-6e5a-430f-bf61-a1af93199b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f25470-fa2b-4c30-b531-bde5715e5801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f25470-fa2b-4c30-b531-bde5715e5801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-545779355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e02c9cc-2e7f-4f82-9d96-fb00507c7f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b20a7b5b3f476aa90188e3e263795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:47Z,use_quota=True,user_id='a149eed435404ed9be655ae6a3439ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe2eb5b5-55b5-4075-9d91-33d76f7bbb94),volume_type_id=fe2eb5b5-55b5-4075-9d91-33d76f7bbb94)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472641d3-cdaf-4d8f-b5fe-abe207f3e314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472641d3-cdaf-4d8f-b5fe-abe207f3e314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207e599a-2007-4111-bb98-32a70acfb2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207e599a-2007-4111-bb98-32a70acfb2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e02c9cc-2e7f-4f82-9d96-fb00507c7f86', 'volume_name': 'volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bc2769-1ee6-40a6-b5ae-bdb82a08ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bc2769-1ee6-40a6-b5ae-bdb82a08ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b45cb61-c872-41d2-8e80-7776c1c22acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume 8e02c9cc-2e7f-4f82-9d96-fb00507c7f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86', 'volume_size': 1} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-545779355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e02c9cc-2e7f-4f82-9d96-fb00507c7f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b20a7b5b3f476aa90188e3e263795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:47Z,use_quota=True,user_id='a149eed435404ed9be655ae6a3439ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe2eb5b5-55b5-4075-9d91-33d76f7bbb94),volume_type_id=fe2eb5b5-55b5-4075-9d91-33d76f7bbb94)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Creating volume 8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:47 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:47 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 1073741824 Jul 31 11:01:47 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Flow 'volume_create_manager' (2d1b14b5-d8f1-4f72-bfe7-42e3fbb284c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae0d24e-6bb7-4c92-9bd6-643b64f85622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae0d24e-6bb7-4c92-9bd6-643b64f85622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-439778952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b20a7b5b3f476aa90188e3e263795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:48Z,use_quota=True,user_id='a149eed435404ed9be655ae6a3439ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be480537-5359-4fbc-ae1a-e3dcd788bc59),volume_type_id=be480537-5359-4fbc-ae1a-e3dcd788bc59)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901cda11-367b-4c9f-a00b-f8f683bbeafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901cda11-367b-4c9f-a00b-f8f683bbeafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e75dd-28be-4bd8-9cfb-75dc03f54895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395e75dd-28be-4bd8-9cfb-75dc03f54895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b', 'volume_name': 'volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d7ddc0-1696-45b2-b85c-b2a4fa98d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d7ddc0-1696-45b2-b85c-b2a4fa98d452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b97ea6-262c-4ba4-a550-48284cb2e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume 6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b', 'volume_size': 1} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:48 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 1073741824" returned: 0 in 0.771s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:48 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 Jul 31 11:01:48 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:48 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" returned: 0 in 0.347s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-439778952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b20a7b5b3f476aa90188e3e263795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:48Z,use_quota=True,user_id='a149eed435404ed9be655ae6a3439ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be480537-5359-4fbc-ae1a-e3dcd788bc59),volume_type_id=be480537-5359-4fbc-ae1a-e3dcd788bc59)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Creating volume 6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:48 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:48 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b 1073741824 Jul 31 11:01:48 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b45cb61-c872-41d2-8e80-7776c1c22acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcc860d-2f2c-4a03-b2ea-f7909c676da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 (8e02c9cc-2e7f-4f82-9d96-fb00507c7f86): created successfully Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bcc860d-2f2c-4a03-b2ea-f7909c676da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Flow 'volume_create_manager' (c22315d0-6e5a-430f-bf61-a1af93199b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Flow 'volume_create_manager' (4100fcad-f148-45d6-9791-ae757139c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae99dcd5-d299-46ec-8e70-a3a178fe55cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-287081a8-40e4-4bfb-97df-bb4181c9c250 tempest-TestInstancesWithCinderVolumes-2093238447 None] Created volume successfully. Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae99dcd5-d299-46ec-8e70-a3a178fe55cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1379104912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ab832b-9179-4f5e-a155-3dc01ad8c66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b20a7b5b3f476aa90188e3e263795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:49Z,use_quota=True,user_id='a149eed435404ed9be655ae6a3439ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82d1382-9d46-4a0c-b31f-6c0d32ac226e),volume_type_id=c82d1382-9d46-4a0c-b31f-6c0d32ac226e)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64021255-4ab3-4503-9789-9422a03c8050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64021255-4ab3-4503-9789-9422a03c8050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559d8a1d-acb0-470f-b500-51193079b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:01:49 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b 1073741824" returned: 0 in 0.739s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559d8a1d-acb0-470f-b500-51193079b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01ab832b-9179-4f5e-a155-3dc01ad8c66b', 'volume_name': 'volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b', 'volume_size': 1, 'image_id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5442748-ea41-4e5f-ae5a-6495d2835a83', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1888241834', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f3b20a7b5b3f476aa90188e3e263795d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'created_at': datetime.datetime(2026, 7, 31, 9, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 1, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5442748-ea41-4e5f-ae5a-6495d2835a83/file', 'properties': {}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21095849-9323-4167-b4af-6f6f949956b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21095849-9323-4167-b4af-6f6f949956b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac412c76-2c88-466a-96a4-da09a67f884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:49 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume 01ab832b-9179-4f5e-a155-3dc01ad8c66b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b', 'volume_size': 1, 'image_id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5442748-ea41-4e5f-ae5a-6495d2835a83', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1888241834', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f3b20a7b5b3f476aa90188e3e263795d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'created_at': datetime.datetime(2026, 7, 31, 9, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 1, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5442748-ea41-4e5f-ae5a-6495d2835a83/file', 'properties': {}}, 'image_service': } Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Trying to clone 01ab832b-9179-4f5e-a155-3dc01ad8c66b from image d5442748-ea41-4e5f-ae5a-6495d2835a83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5442748-ea41-4e5f-ae5a-6495d2835a83', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:01:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:49 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b Jul 31 11:01:49 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:50 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" returned: 0 in 0.349s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b97ea6-262c-4ba4-a550-48284cb2e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7aa16c-1280-4978-9248-4709e20d1406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b (6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b): created successfully Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7aa16c-1280-4978-9248-4709e20d1406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Flow 'volume_create_manager' (2d1b14b5-d8f1-4f72-bfe7-42e3fbb284c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c4a731a7-bd72-4367-a620-5e35c34e01b0 tempest-TestInstancesWithCinderVolumes-2093238447 None] Created volume successfully. Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Flow 'volume_create_manager' (399b6538-9f16-4203-907d-fe53c287fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301a368d-8b19-4401-b554-b2861f148faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301a368d-8b19-4401-b554-b2861f148faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-247233442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821d70ae-febe-44e1-8f48-8fa6af54483d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd8636cbda4cd99b68a1eb3fcbf269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:53Z,use_quota=True,user_id='5e478110542849e3bc2fe87d41e236e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86481438-bdac-4506-9922-68c85f8a3379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86481438-bdac-4506-9922-68c85f8a3379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb8117a-2e90-4303-aa7c-eff241f15a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb8117a-2e90-4303-aa7c-eff241f15a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821d70ae-febe-44e1-8f48-8fa6af54483d', 'volume_name': 'volume-821d70ae-febe-44e1-8f48-8fa6af54483d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d19a174-7a32-4b41-8cfd-d4d7974a3c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d19a174-7a32-4b41-8cfd-d4d7974a3c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e538d6a2-ccbb-4f82-8035-77cefa5f4b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Volume 821d70ae-febe-44e1-8f48-8fa6af54483d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821d70ae-febe-44e1-8f48-8fa6af54483d', 'volume_size': 1} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-247233442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821d70ae-febe-44e1-8f48-8fa6af54483d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd8636cbda4cd99b68a1eb3fcbf269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:53Z,use_quota=True,user_id='5e478110542849e3bc2fe87d41e236e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Creating volume 821d70ae-febe-44e1-8f48-8fa6af54483d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:53 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:53 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d 1073741824 Jul 31 11:01:53 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Flow 'volume_create_manager' (dd3b6a4b-9624-490b-80d8-5604d69282bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151560fd-0d58-459d-ad26-81148c2444d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151560fd-0d58-459d-ad26-81148c2444d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1575622132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ab683d-f2c6-469d-9c06-65088e100904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20294a67e4524a38ac9bbb7ef5c2d0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:54Z,use_quota=True,user_id='de15f8cde19a4703a5729959454fb6a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecad46fa-b2d4-450a-9c05-eeb88f5743f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecad46fa-b2d4-450a-9c05-eeb88f5743f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d476a41c-39f1-4e73-b906-43f1bcc20932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d476a41c-39f1-4e73-b906-43f1bcc20932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ab683d-f2c6-469d-9c06-65088e100904', 'volume_name': 'volume-b8ab683d-f2c6-469d-9c06-65088e100904', 'volume_size': 2}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597a72e3-7703-47e4-9cf3-2bffbd21ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597a72e3-7703-47e4-9cf3-2bffbd21ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b49ce-1fe5-4738-a344-67865abb8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Volume b8ab683d-f2c6-469d-9c06-65088e100904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ab683d-f2c6-469d-9c06-65088e100904', 'volume_size': 2} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d 1073741824" returned: 0 in 0.681s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:54 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d Jul 31 11:01:54 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Flow 'volume_create_manager' (ce9e5ba7-a370-480d-83db-c3f1f69f48f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd56005d-d2cd-478f-8209-c5982d085f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd56005d-d2cd-478f-8209-c5982d085f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1080181843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a52001-68dc-4135-b9fc-a87a8217fac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd8636cbda4cd99b68a1eb3fcbf269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:54Z,use_quota=True,user_id='5e478110542849e3bc2fe87d41e236e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5de104e-e2e2-4c27-9635-3fb57adf76bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5de104e-e2e2-4c27-9635-3fb57adf76bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa7a9ef-11bc-4e4c-ad4d-bce9eb7202ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa7a9ef-11bc-4e4c-ad4d-bce9eb7202ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a52001-68dc-4135-b9fc-a87a8217fac7', 'volume_name': 'volume-a4a52001-68dc-4135-b9fc-a87a8217fac7', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539446a0-1c4a-45cb-ae83-599ceb4a2578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539446a0-1c4a-45cb-ae83-599ceb4a2578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ce40aa-74c4-4625-a48d-cb793e6ee001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Volume a4a52001-68dc-4135-b9fc-a87a8217fac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a52001-68dc-4135-b9fc-a87a8217fac7', 'volume_size': 1} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:54 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d" returned: 0 in 0.488s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1575622132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ab683d-f2c6-469d-9c06-65088e100904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20294a67e4524a38ac9bbb7ef5c2d0e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:54Z,use_quota=True,user_id='de15f8cde19a4703a5729959454fb6a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Creating volume b8ab683d-f2c6-469d-9c06-65088e100904 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:54 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 2147483648 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:54 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 2147483648 Jul 31 11:01:54 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e538d6a2-ccbb-4f82-8035-77cefa5f4b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821d70ae-febe-44e1-8f48-8fa6af54483d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec6a232-e57f-448c-b9bc-ac649d82c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Volume volume-821d70ae-febe-44e1-8f48-8fa6af54483d (821d70ae-febe-44e1-8f48-8fa6af54483d): created successfully Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec6a232-e57f-448c-b9bc-ac649d82c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Flow 'volume_create_manager' (399b6538-9f16-4203-907d-fe53c287fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6b612172-c4d7-4e46-9c99-ea1589a3a22b tempest-TestServerVolumeAttachmentScenario-912017064 None] Created volume successfully. Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD, size 20.69 MB, duration 5.57 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:01:55 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Image download 20.69 MB at 3.72 MB/s Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669ff8f-250b-42ba-ab64-38b1383d7af4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:55 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD Jul 31 11:01:55 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:55 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 2147483648" returned: 0 in 0.706s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:55 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 Jul 31 11:01:55 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:55 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Temporary image d5442748-ea41-4e5f-ae5a-6495d2835a83 is fetched for user a149eed435404ed9be655ae6a3439ddb. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:01:55 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904" returned: 0 in 0.326s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1080181843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a52001-68dc-4135-b9fc-a87a8217fac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd8636cbda4cd99b68a1eb3fcbf269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:54Z,use_quota=True,user_id='5e478110542849e3bc2fe87d41e236e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Creating volume a4a52001-68dc-4135-b9fc-a87a8217fac7 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:55 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (722b49ce-1fe5-4738-a344-67865abb8750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ab683d-f2c6-469d-9c06-65088e100904', 'volume_size': 2}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:55 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 1073741824 Jul 31 11:01:55 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb9c0ff-a907-4d6a-96ae-5ff099358cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec920b-3255-493c-9226-4cd352a1e9fc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Volume volume-b8ab683d-f2c6-469d-9c06-65088e100904 (b8ab683d-f2c6-469d-9c06-65088e100904): created successfully Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb9c0ff-a907-4d6a-96ae-5ff099358cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Flow 'volume_create_manager' (dd3b6a4b-9624-490b-80d8-5604d69282bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9a2a8092-d386-4b8b-956f-cc08390a70d0 tempest-VolumesCloneNegativeTest-2016253186 None] Created volume successfully. Jul 31 11:01:56 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD Jul 31 11:01:56 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:56 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:56 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 1073741824" returned: 0 in 0.551s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:56 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 Jul 31 11:01:56 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:56 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1379104912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ab832b-9179-4f5e-a155-3dc01ad8c66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b20a7b5b3f476aa90188e3e263795d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:01:49Z,use_quota=True,user_id='a149eed435404ed9be655ae6a3439ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82d1382-9d46-4a0c-b31f-6c0d32ac226e),volume_type_id=c82d1382-9d46-4a0c-b31f-6c0d32ac226e)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Creating volume 01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ce40aa-74c4-4625-a48d-cb793e6ee001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a52001-68dc-4135-b9fc-a87a8217fac7', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:56 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b 1073741824 Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb04540a-5e32-4398-91f7-e27333e13c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:56 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Volume volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 (a4a52001-68dc-4135-b9fc-a87a8217fac7): created successfully Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb04540a-5e32-4398-91f7-e27333e13c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Flow 'volume_create_manager' (ce9e5ba7-a370-480d-83db-c3f1f69f48f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b44a128c-e5cf-4c49-b9ec-cc492804ffb3 tempest-TestServerVolumeAttachmentScenario-912017064 None] Created volume successfully. Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Acquiring lock "cinder-b8ab683d-f2c6-469d-9c06-65088e100904-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Lock "cinder-b8ab683d-f2c6-469d-9c06-65088e100904-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Acquiring lock "cinder-quobyte-b8ab683d-f2c6-469d-9c06-65088e100904" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Lock "cinder-quobyte-b8ab683d-f2c6-469d-9c06-65088e100904" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e59481-35e1-47cc-bd73-1f45868204fa]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b 1073741824" returned: 0 in 0.599s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:01:57 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:57 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 Jul 31 11:01:57 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:57 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 0 in 0.329s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Attempting download of d5442748-ea41-4e5f-ae5a-6495d2835a83 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5442748-ea41-4e5f-ae5a-6495d2835a83', 'metadata': {}}])) to volume 01ab832b-9179-4f5e-a155-3dc01ad8c66b. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:01:57 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904" returned: 0 in 0.458s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904 Jul 31 11:01:57 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d915505f-96bb-4450-ba58-90e329748675]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:57 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz Jul 31 11:01:57 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:58 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b8ab683d-f2c6-469d-9c06-65088e100904" returned: 0 in 0.343s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Lock "cinder-quobyte-b8ab683d-f2c6-469d-9c06-65088e100904" released by "delete_volume" :: held 0.860s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:58 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz" returned: 0 in 0.390s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Created reservations ['ca4bb108-06f2-4a50-a2ba-63bc0d0f01e8', '4eeb251f-a1fb-48a1-89e0-7e8428dead3a', '6cc38049-66d3-40aa-a228-e40f8147b3cb', '080c6729-3305-4119-8b1f-426bfe2b61e3'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:01:58 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz Jul 31 11:01:58 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:58 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:01:58 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:58 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz" returned: 1 in 0.403s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5442748-ea41-4e5f-ae5a-6495d2835a83_aek58bpz' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30c329-5869-47a8-99c6-94f94297e6ab]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:58 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD Jul 31 11:01:58 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:58 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.392s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:01:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Deleted volume successfully. Jul 31 11:01:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f5dae70-929f-45b8-8c4f-196f0ba725fd tempest-VolumesCloneNegativeTest-2016253186 None] Lock "cinder-b8ab683d-f2c6-469d-9c06-65088e100904-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:01:59 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] d5442748-ea41-4e5f-ae5a-6495d2835a83 was qcow2, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:59 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:01:59 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Flow 'volume_create_manager' (cb0ec6c0-cbbd-47e4-9089-156cf65516ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a89bbd4-2f17-4434-91a3-098e397ea1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a89bbd4-2f17-4434-91a3-098e397ea1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1565469626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9ee0be-509b-4466-bf17-39c40f0dc3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf26a023ff3492d9181a9186a54a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:00Z,use_quota=True,user_id='1fff7cb3fae34d00869e5c820cece465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaea02b-2306-4e86-abe6-486979cde11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaea02b-2306-4e86-abe6-486979cde11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a60fa2-4902-4a1e-a444-8206dcb13b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a60fa2-4902-4a1e-a444-8206dcb13b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9ee0be-509b-4466-bf17-39c40f0dc3d0', 'volume_name': 'volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf79c3a-b16f-4723-a8f4-5de95ec42f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf79c3a-b16f-4723-a8f4-5de95ec42f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5a396b-ebef-43dc-95d1-37924c080604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:01:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Volume da9ee0be-509b-4466-bf17-39c40f0dc3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0', 'volume_size': 1} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1565469626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9ee0be-509b-4466-bf17-39c40f0dc3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf26a023ff3492d9181a9186a54a311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:00Z,use_quota=True,user_id='1fff7cb3fae34d00869e5c820cece465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Creating volume da9ee0be-509b-4466-bf17-39c40f0dc3d0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:01:59 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:01:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:01:59 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 1073741824 Jul 31 11:01:59 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:00 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 1073741824" returned: 0 in 0.747s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:00 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 Jul 31 11:02:00 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:01 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0" returned: 0 in 0.396s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5a396b-ebef-43dc-95d1-37924c080604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d7f80a-ec93-47ce-b41d-cd0d4a34fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Volume volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 (da9ee0be-509b-4466-bf17-39c40f0dc3d0): created successfully Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d7f80a-ec93-47ce-b41d-cd0d4a34fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Flow 'volume_create_manager' (cb0ec6c0-cbbd-47e4-9089-156cf65516ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-762b7ad6-c8e5-4939-8473-7f63bf93c893 tempest-VolumesServicesTestJSON-1637322864 None] Created volume successfully. Jul 31 11:02:01 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 0 in 2.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5442748-ea41-4e5f-ae5a-6495d2835a83_6lkd34b3devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:02:01 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Converted 112.00 MB image at 48.87 MB/s Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:01 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b 1G Jul 31 11:02:01 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:01 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b 1G" returned: 0 in 0.511s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed2cf51-1a0d-4d07-9374-ae25411d66fd]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Acquiring lock "cinder-da9ee0be-509b-4466-bf17-39c40f0dc3d0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Lock "cinder-da9ee0be-509b-4466-bf17-39c40f0dc3d0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Acquiring lock "cinder-quobyte-da9ee0be-509b-4466-bf17-39c40f0dc3d0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Lock "cinder-quobyte-da9ee0be-509b-4466-bf17-39c40f0dc3d0" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:02 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:02:02 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9ca173-6706-48c7-badf-265a2d5301ff]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:02 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 Jul 31 11:02:02 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:02 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 0 in 0.465s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:02 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:02:02 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:02 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0" returned: 0 in 0.479s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:02 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0 Jul 31 11:02:02 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:02 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 1 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Downloaded image d5442748-ea41-4e5f-ae5a-6495d2835a83 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5442748-ea41-4e5f-ae5a-6495d2835a83', 'metadata': {}}])) to volume 01ab832b-9179-4f5e-a155-3dc01ad8c66b successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Temporary image d5442748-ea41-4e5f-ae5a-6495d2835a83 for user a149eed435404ed9be655ae6a3439ddb is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Marking volume 01ab832b-9179-4f5e-a155-3dc01ad8c66b as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Copying metadata from image d5442748-ea41-4e5f-ae5a-6495d2835a83 to 01ab832b-9179-4f5e-a155-3dc01ad8c66b. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Creating volume glance metadata for volume 01ab832b-9179-4f5e-a155-3dc01ad8c66b backed by image d5442748-ea41-4e5f-ae5a-6495d2835a83 with: {'image_id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'image_name': 'tempest-scenario-img--1888241834', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac412c76-2c88-466a-96a4-da09a67f884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b', 'volume_size': 1, 'image_id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5442748-ea41-4e5f-ae5a-6495d2835a83', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1888241834', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f3b20a7b5b3f476aa90188e3e263795d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd5442748-ea41-4e5f-ae5a-6495d2835a83', 'created_at': datetime.datetime(2026, 7, 31, 9, 1, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 1, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5442748-ea41-4e5f-ae5a-6495d2835a83/file', 'properties': {}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:02 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c618056-4aa4-4cf3-aad7-1d879f61383a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-da9ee0be-509b-4466-bf17-39c40f0dc3d0" returned: 0 in 0.387s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Lock "cinder-quobyte-da9ee0be-509b-4466-bf17-39c40f0dc3d0" released by "delete_volume" :: held 0.943s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Volume volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b (01ab832b-9179-4f5e-a155-3dc01ad8c66b): created successfully Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c618056-4aa4-4cf3-aad7-1d879f61383a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Flow 'volume_create_manager' (4100fcad-f148-45d6-9791-ae757139c489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4ff19f5a-f0b9-4621-902f-670525c3a65f tempest-TestInstancesWithCinderVolumes-2093238447 None] Created volume successfully. Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Created reservations ['355ad4eb-1aa4-44c2-b518-eee7a62f5672', '3e561af2-d6da-4cc1-83d0-97f8bc08ec8d', '580631e3-c645-453f-a7ad-8ccdd33e500a', 'fa2c28bf-af8a-40b4-9f38-a3b5a1d16dc7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:03 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:03 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:03 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.320s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Deleted volume successfully. Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7293f430-1d44-4a84-925f-2a873e6e2d79 tempest-VolumesServicesTestJSON-1637322864 None] Lock "cinder-da9ee0be-509b-4466-bf17-39c40f0dc3d0-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Flow 'volume_create_manager' (ed492fff-4a38-4cf6-861b-152c1123bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f977b2-256d-429d-9107-5d49f4213f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f977b2-256d-429d-9107-5d49f4213f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1612217589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449c292e-6019-4585-a31d-d8c017d3842b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a5ccb56dc4c3d83dae148fa6d47aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:04Z,use_quota=True,user_id='7916b754ff494a0fac8e76614a1a55bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947204bd-7667-48a7-ac7f-46eee1076541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947204bd-7667-48a7-ac7f-46eee1076541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a7dd5-0768-4f93-8659-53a9fe443a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a7dd5-0768-4f93-8659-53a9fe443a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449c292e-6019-4585-a31d-d8c017d3842b', 'volume_name': 'volume-449c292e-6019-4585-a31d-d8c017d3842b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba508af4-a792-4352-bbb1-729b76cf0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba508af4-a792-4352-bbb1-729b76cf0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a38ead-547e-4420-addd-dd1a0d10e106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Volume 449c292e-6019-4585-a31d-d8c017d3842b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449c292e-6019-4585-a31d-d8c017d3842b', 'volume_size': 1} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1612217589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449c292e-6019-4585-a31d-d8c017d3842b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236a5ccb56dc4c3d83dae148fa6d47aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:04Z,use_quota=True,user_id='7916b754ff494a0fac8e76614a1a55bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Creating volume 449c292e-6019-4585-a31d-d8c017d3842b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:03 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:03 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b 1073741824 Jul 31 11:02:03 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:04 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b 1073741824" returned: 0 in 0.924s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:04 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b Jul 31 11:02:04 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:05 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b" returned: 0 in 0.409s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a38ead-547e-4420-addd-dd1a0d10e106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449c292e-6019-4585-a31d-d8c017d3842b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdb16ea-f519-4b15-bb87-1056cbf6f910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:05 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Volume volume-449c292e-6019-4585-a31d-d8c017d3842b (449c292e-6019-4585-a31d-d8c017d3842b): created successfully Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdb16ea-f519-4b15-bb87-1056cbf6f910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Flow 'volume_create_manager' (ed492fff-4a38-4cf6-861b-152c1123bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-047f27e3-2ea0-4257-aada-00a92484c34b tempest-VolumesNegativeTest-475660404 None] Created volume successfully. Jul 31 11:02:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca523cc-3c9d-4edb-bb47-cc9c82d4ae87]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:10 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:02:10 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:11 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 0 in 1.067s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:11 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:02:11 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:11 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 1 in 0.521s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:02:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.683s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68548d93-a01d-4cdd-a536-f2a136dc3708', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:02:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-01477893-c2e4-40bc-a5d3-1b201570c119 req-b2266535-4afe-4720-b8a0-b0d0e6643669 tempest-TestInstancesWithCinderVolumes-2093238447 None] attachment_update completed successfully. Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Flow 'volume_create_manager' (83231a53-e54c-4f3e-9428-8e0f5f861554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df9b977-1d4b-4a0f-a411-867fa180657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df9b977-1d4b-4a0f-a411-867fa180657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-239358349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f1456d-0138-4ea5-a380-8f0e9cb1f12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d359266be04bbea24503fd39c756d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:16Z,use_quota=True,user_id='ec3821ea94f34b579731369e67575d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195cc3a7-be65-4902-9da5-6e0d9a74fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195cc3a7-be65-4902-9da5-6e0d9a74fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4026b3c-38e2-4fe0-b6bf-a649a7692f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4026b3c-38e2-4fe0-b6bf-a649a7692f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f1456d-0138-4ea5-a380-8f0e9cb1f12d', 'volume_name': 'volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b9c132-4b0f-40db-877b-c22e9dc980ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b9c132-4b0f-40db-877b-c22e9dc980ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7abf68-9c64-41d5-9392-72b052835e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:16 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Volume 57f1456d-0138-4ea5-a380-8f0e9cb1f12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d', 'volume_size': 1} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-239358349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f1456d-0138-4ea5-a380-8f0e9cb1f12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d359266be04bbea24503fd39c756d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:16Z,use_quota=True,user_id='ec3821ea94f34b579731369e67575d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Creating volume 57f1456d-0138-4ea5-a380-8f0e9cb1f12d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:16 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:16 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d 1073741824 Jul 31 11:02:16 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:17 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d 1073741824" returned: 0 in 1.608s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:17 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d Jul 31 11:02:17 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:18 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d" returned: 0 in 0.685s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7abf68-9c64-41d5-9392-72b052835e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc673f3-4f6f-4fa9-a76f-47acb8b3de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:18 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Volume volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d (57f1456d-0138-4ea5-a380-8f0e9cb1f12d): created successfully Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc673f3-4f6f-4fa9-a76f-47acb8b3de60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Flow 'volume_create_manager' (83231a53-e54c-4f3e-9428-8e0f5f861554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d01aec90-265d-47f0-8d72-d1d6dd652064 tempest-VolumesTransfersTest-1248616598 None] Created volume successfully. Jul 31 11:02:20 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c3937b44-9bfe-4bd1-b79d-dbaa2742f547 tempest-VolumesTransfersTest-1195086375 None] Transfer volume completed successfully. Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Acquiring lock "cinder-57f1456d-0138-4ea5-a380-8f0e9cb1f12d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-57f1456d-0138-4ea5-a380-8f0e9cb1f12d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Acquiring lock "cinder-quobyte-57f1456d-0138-4ea5-a380-8f0e9cb1f12d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-quobyte-57f1456d-0138-4ea5-a380-8f0e9cb1f12d" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a953c93-b006-4dd4-b40c-0642f1fc8f73]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:21 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d Jul 31 11:02:21 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:21 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d" returned: 0 in 0.596s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:21 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d Jul 31 11:02:21 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:22 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-57f1456d-0138-4ea5-a380-8f0e9cb1f12d" returned: 0 in 0.283s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-quobyte-57f1456d-0138-4ea5-a380-8f0e9cb1f12d" released by "delete_volume" :: held 0.961s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Created reservations ['b9c13f1b-e52b-401e-a542-dc7d0b42014e', '5065c226-edc7-469c-92f2-7a0c15f54623', '0502b884-420a-4106-a325-0afe4d73e1d7', '437b1bd5-458e-474a-9c47-969871f3306a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:22 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:22 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:22 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:22 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Deleted volume successfully. Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d1ef7342-0602-4bbe-86ff-dfb4345cb5a5 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-57f1456d-0138-4ea5-a380-8f0e9cb1f12d-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Flow 'volume_create_manager' (3468c082-18dd-4b24-a099-06e1521994b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d6d6a1-7af4-419a-9fb6-d9742e845220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d6d6a1-7af4-419a-9fb6-d9742e845220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1449803273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776c8810-22e6-4081-a2dc-71155c2e6839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d359266be04bbea24503fd39c756d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:23Z,use_quota=True,user_id='ec3821ea94f34b579731369e67575d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b88f460-dfa7-4f75-9b23-68972d75dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b88f460-dfa7-4f75-9b23-68972d75dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d05583-fac3-45a0-8eb6-4e313680f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d05583-fac3-45a0-8eb6-4e313680f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776c8810-22e6-4081-a2dc-71155c2e6839', 'volume_name': 'volume-776c8810-22e6-4081-a2dc-71155c2e6839', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36d88e-7874-48ca-9424-903ddadc04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36d88e-7874-48ca-9424-903ddadc04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12290c8-a041-4d38-b059-662040c8d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:23 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Volume 776c8810-22e6-4081-a2dc-71155c2e6839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776c8810-22e6-4081-a2dc-71155c2e6839', 'volume_size': 1} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1449803273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776c8810-22e6-4081-a2dc-71155c2e6839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d359266be04bbea24503fd39c756d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:23Z,use_quota=True,user_id='ec3821ea94f34b579731369e67575d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Creating volume 776c8810-22e6-4081-a2dc-71155c2e6839 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:23 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:23 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 1073741824 Jul 31 11:02:23 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:24 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 1073741824" returned: 0 in 0.495s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:24 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 Jul 31 11:02:24 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:24 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839" returned: 0 in 0.513s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12290c8-a041-4d38-b059-662040c8d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776c8810-22e6-4081-a2dc-71155c2e6839', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c198a0d-5b86-4836-88cd-5b7763631b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:24 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Volume volume-776c8810-22e6-4081-a2dc-71155c2e6839 (776c8810-22e6-4081-a2dc-71155c2e6839): created successfully Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c198a0d-5b86-4836-88cd-5b7763631b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Flow 'volume_create_manager' (3468c082-18dd-4b24-a099-06e1521994b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-204d1b21-ec8c-4e6a-bcac-cb5b8e183b5e tempest-VolumesTransfersTest-1248616598 None] Created volume successfully. Jul 31 11:02:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Acquiring lock "cinder-776c8810-22e6-4081-a2dc-71155c2e6839-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-776c8810-22e6-4081-a2dc-71155c2e6839-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Acquiring lock "cinder-quobyte-776c8810-22e6-4081-a2dc-71155c2e6839" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-quobyte-776c8810-22e6-4081-a2dc-71155c2e6839" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:26 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a268621-4f7e-4c70-974e-be399967e813]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:26 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 Jul 31 11:02:26 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:27 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839" returned: 0 in 0.572s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:27 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839 Jul 31 11:02:27 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:27 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-776c8810-22e6-4081-a2dc-71155c2e6839" returned: 0 in 0.429s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-quobyte-776c8810-22e6-4081-a2dc-71155c2e6839" released by "delete_volume" :: held 1.115s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:27 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Created reservations ['6a320a1a-6848-4eac-b5d6-2c197a7f6377', '59bed6bc-2a4b-488f-b5d9-ed5f59142a1b', '16858526-25c1-4c99-bc83-9acb962034af', 'cd734813-fe6e-4506-b70b-cf086e9836de'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:28 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:28 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:28 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.601s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Deleted volume successfully. Jul 31 11:02:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8bb28212-4691-460d-912d-861dad6f4738 tempest-VolumesTransfersTest-1770703681 None] Lock "cinder-776c8810-22e6-4081-a2dc-71155c2e6839-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:36 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=81,cinder:INSERT=28,cinder:UPDATE=105,cinder:DELETE=10 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:02:36 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=81,cinder:UPDATE=112,cinder:DELETE=12,cinder:INSERT=27 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:02:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:36 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ff92a-a90c-4005-b6f6-5d91008105d0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:36 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d Jul 31 11:02:36 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:37 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d" returned: 0 in 0.497s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.527s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-821d70ae-febe-44e1-8f48-8fa6af54483d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58352103-425e-41cf-87f8-f67a26a45522', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:02:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-50862da9-1780-4daf-91a6-d5587662ed01 req-a6abf1cf-2cde-4b78-b2d9-56b536bd8ab5 tempest-TestServerVolumeAttachmentScenario-912017064 None] attachment_update completed successfully. Jul 31 11:02:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Acquiring lock "cinder-449c292e-6019-4585-a31d-d8c017d3842b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Lock "cinder-449c292e-6019-4585-a31d-d8c017d3842b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Acquiring lock "cinder-quobyte-449c292e-6019-4585-a31d-d8c017d3842b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Lock "cinder-quobyte-449c292e-6019-4585-a31d-d8c017d3842b" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:39 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa970eac-4877-4c71-baa6-26b4d51506de]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b Jul 31 11:02:40 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Flow 'volume_create_manager' (7c0bb27e-31c2-424f-9c51-b09da1ecc896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef22f8be-92f5-4d14-a707-edd285fb1196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef22f8be-92f5-4d14-a707-edd285fb1196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-184957285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc526a9-2434-40dd-b7d4-a826246f2d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bafb6494d6a40388c5a364f14198d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:40Z,use_quota=True,user_id='78a24e92468b4998a82fbb5b7816fd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c109aad-4e2f-4fd4-8c0b-6987afc71810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c109aad-4e2f-4fd4-8c0b-6987afc71810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c571678d-22ea-44a8-9080-ef7df606e6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c571678d-22ea-44a8-9080-ef7df606e6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc526a9-2434-40dd-b7d4-a826246f2d9d', 'volume_name': 'volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c59536-0b7f-411b-89cc-12457b8163a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c59536-0b7f-411b-89cc-12457b8163a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51868b67-4abe-4848-a9cf-d94e0c4c2cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Volume 4bc526a9-2434-40dd-b7d4-a826246f2d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d', 'volume_size': 1} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-184957285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc526a9-2434-40dd-b7d4-a826246f2d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bafb6494d6a40388c5a364f14198d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:40Z,use_quota=True,user_id='78a24e92468b4998a82fbb5b7816fd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Creating volume 4bc526a9-2434-40dd-b7d4-a826246f2d9d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:40 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d 1073741824 Jul 31 11:02:40 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:40 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b" returned: 0 in 0.484s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b Jul 31 11:02:40 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:40 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:40 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d 1073741824" returned: 0 in 0.524s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-449c292e-6019-4585-a31d-d8c017d3842b" returned: 0 in 0.329s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Lock "cinder-quobyte-449c292e-6019-4585-a31d-d8c017d3842b" released by "delete_volume" :: held 0.911s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d Jul 31 11:02:40 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Created reservations ['63855a00-0645-4809-a1dc-2d5da247502b', '58721ed2-5dd7-4dc4-91fb-19d47ed99f78', 'eecf9dfd-bdbb-42d8-916c-4f9e4c691121', '95eb211d-246f-4c1a-a163-ebfb6fb0e892'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:40 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:40 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:41 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d" returned: 0 in 0.331s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51868b67-4abe-4848-a9cf-d94e0c4c2cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a8e042-62aa-4991-bc6d-989d6c8fab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:41 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Volume volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d (4bc526a9-2434-40dd-b7d4-a826246f2d9d): created successfully Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a8e042-62aa-4991-bc6d-989d6c8fab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Flow 'volume_create_manager' (7c0bb27e-31c2-424f-9c51-b09da1ecc896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-641acc34-7746-4418-b0b1-f845663168ac tempest-VolumesTransfersV355Test-1091456879 None] Created volume successfully. Jul 31 11:02:41 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.333s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Deleted volume successfully. Jul 31 11:02:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db4de026-797d-4c87-9390-59f46c044959 tempest-VolumesNegativeTest-475660404 None] Lock "cinder-449c292e-6019-4585-a31d-d8c017d3842b-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7c74e820-c195-449b-b926-03f744ecc704 tempest-VolumesTransfersV355Test-1151704812 None] Transfer volume completed successfully. Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[304d3926-52f7-4439-b6bf-f969ffe2c368]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:43 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 Jul 31 11:02:43 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:43 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7" returned: 0 in 0.382s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.405s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-a4a52001-68dc-4135-b9fc-a87a8217fac7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7cf5e67-9def-4f9d-9b45-bb06dd684491', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:02:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-60cfc739-b4de-44fb-84bb-a4e2912ba89e req-90ce03a1-70c2-4c29-9b79-ac19b4016c72 tempest-TestServerVolumeAttachmentScenario-912017064 None] attachment_update completed successfully. Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Acquiring lock "cinder-4bc526a9-2434-40dd-b7d4-a826246f2d9d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (73057fab-6363-470f-9c52-132324ebbdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac09950-eecb-493d-9a00-b8eb8a020b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-4bc526a9-2434-40dd-b7d4-a826246f2d9d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac09950-eecb-493d-9a00-b8eb8a020b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1452982578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619b3db1-c9ff-4200-bf0b-669278e0ad49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:44Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582d9a37-9f97-4463-bc96-d95d1eff3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582d9a37-9f97-4463-bc96-d95d1eff3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46438bb8-dcc5-4857-b8b9-99408271b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46438bb8-dcc5-4857-b8b9-99408271b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619b3db1-c9ff-4200-bf0b-669278e0ad49', 'volume_name': 'volume-619b3db1-c9ff-4200-bf0b-669278e0ad49', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3426e4-ec8c-4f9e-a047-0f64fc6564cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3426e4-ec8c-4f9e-a047-0f64fc6564cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ad9ee0-0422-4802-97a3-d18feed92530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume 619b3db1-c9ff-4200-bf0b-669278e0ad49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619b3db1-c9ff-4200-bf0b-669278e0ad49', 'volume_size': 1} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1452982578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619b3db1-c9ff-4200-bf0b-669278e0ad49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:44Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating volume 619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:44 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:44 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 1073741824 Jul 31 11:02:44 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Acquiring lock "cinder-quobyte-4bc526a9-2434-40dd-b7d4-a826246f2d9d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-quobyte-4bc526a9-2434-40dd-b7d4-a826246f2d9d" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e0b1af-d324-48e2-83ea-9e02cbdcc139]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:44 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d Jul 31 11:02:44 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:44 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 1073741824" returned: 0 in 0.460s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:44 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d" returned: 0 in 0.392s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:44 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d Jul 31 11:02:44 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:44 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 Jul 31 11:02:44 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:44 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4bc526a9-2434-40dd-b7d4-a826246f2d9d" returned: 0 in 0.243s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-quobyte-4bc526a9-2434-40dd-b7d4-a826246f2d9d" released by "delete_volume" :: held 0.684s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:44 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49" returned: 0 in 0.262s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ad9ee0-0422-4802-97a3-d18feed92530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619b3db1-c9ff-4200-bf0b-669278e0ad49', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5c2c9-5686-4591-bf64-87d8b33de672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 (619b3db1-c9ff-4200-bf0b-669278e0ad49): created successfully Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5c2c9-5686-4591-bf64-87d8b33de672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (73057fab-6363-470f-9c52-132324ebbdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Created reservations ['3f76ecad-0df4-4986-9c86-5f84bf5febb6', 'f6cd8846-6cd7-4310-a91f-ca3297de43d3', '24dcf2ce-925d-4162-bdec-dfdf4bdc8170', 'd43a1cf2-c571-4b6d-bd18-d8ef5c7384f1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-41aa3c1e-c6de-40f4-a00d-7ea12c23e7bf tempest-CreateVolumesFromSnapshotTest-444275415 None] Created volume successfully. Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:45 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:45 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:45 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Deleted volume successfully. Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-add91c41-f2b5-4c0f-ae90-4df4969489ac tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-4bc526a9-2434-40dd-b7d4-a826246f2d9d-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Flow 'volume_create_manager' (65b45213-30a0-4200-8516-79239943fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bab8e34-a5fb-4bf8-969c-4c0b591d8221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bab8e34-a5fb-4bf8-969c-4c0b591d8221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-709410306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bafb6494d6a40388c5a364f14198d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:46Z,use_quota=True,user_id='78a24e92468b4998a82fbb5b7816fd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626fad61-3f7e-49a9-847f-8319e469cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626fad61-3f7e-49a9-847f-8319e469cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15acc03b-5889-49fc-bd22-e316ea008094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15acc03b-5889-49fc-bd22-e316ea008094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b', 'volume_name': 'volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f1acf2-6fd7-4abb-a1e3-3ae8f5fa4eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f1acf2-6fd7-4abb-a1e3-3ae8f5fa4eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6afa97-1e85-43c0-ac7d-39c748b6ea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:45 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Volume 7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b', 'volume_size': 1} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-709410306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bafb6494d6a40388c5a364f14198d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:46Z,use_quota=True,user_id='78a24e92468b4998a82fbb5b7816fd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Creating volume 7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:45 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:45 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b 1073741824 Jul 31 11:02:45 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:46 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-d551963d-8896-4ed5-a811-f655499a76ff req-37503a77-ec92-4c7a-8675-c5764ab99517 tempest-TestServerVolumeAttachmentScenario-912017064 None] Terminate volume connection completed successfully. Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-d551963d-8896-4ed5-a811-f655499a76ff req-37503a77-ec92-4c7a-8675-c5764ab99517 tempest-TestServerVolumeAttachmentScenario-912017064 None] Deleting attachment c7cf5e67-9def-4f9d-9b45-bb06dd684491. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:46 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b 1073741824" returned: 0 in 0.636s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:46 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:46 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:46 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b Jul 31 11:02:46 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:46 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.309s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:02:46 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.510s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6afa97-1e85-43c0-ac7d-39c748b6ea7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f91023-dfef-4ac2-a943-0fe7e13c750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating offline snapshot 3434cd88-d350-4b0a-8c23-9026becaec68 of volume 619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:02:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Volume volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b (7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b): created successfully Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f91023-dfef-4ac2-a943-0fe7e13c750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Flow 'volume_create_manager' (65b45213-30a0-4200-8516-79239943fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fbba46-0684-4e32-999b-eadba972ec22]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-32eaf401-f912-4fe3-ae07-08d6392f3732 tempest-VolumesTransfersV355Test-1091456879 None] Created volume successfully. Jul 31 11:02:47 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 Jul 31 11:02:47 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:47 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:47 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 1G Jul 31 11:02:47 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-72807c8f-edac-47a3-a344-101bebfb6766 req-ddd97474-159a-4065-991c-8a10b72b0446 tempest-TestServerVolumeAttachmentScenario-912017064 None] Terminate volume connection completed successfully. Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-72807c8f-edac-47a3-a344-101bebfb6766 req-ddd97474-159a-4065-991c-8a10b72b0446 tempest-TestServerVolumeAttachmentScenario-912017064 None] Deleting attachment 58352103-425e-41cf-87f8-f67a26a45522. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:02:47 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 1G" returned: 0 in 0.464s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:47 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 Jul 31 11:02:47 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Acquiring lock "cinder-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:48 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:48 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 is being set with open permissions: ugo+rw Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Acquiring lock "cinder-quobyte-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:48 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 Jul 31 11:02:48 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-quobyte-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8bc31b-200a-4678-94b4-f5d759c758af]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:48 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b Jul 31 11:02:48 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:48 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68" returned: 0 in 0.393s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:48 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info Jul 31 11:02:48 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:49 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b" returned: 0 in 0.539s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b Jul 31 11:02:49 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:49 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info is being set with open permissions: ugo+rw Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info Jul 31 11:02:49 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:49 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b" returned: 0 in 0.524s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-quobyte-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b" released by "delete_volume" :: held 1.111s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:49 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.info" returned: 0 in 0.449s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.687s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Created reservations ['56bae010-dfea-4959-bb8d-ddb8d21a7404', '6d74b0a6-dab9-4efa-8b4f-0ab5910ca692', '4be91d6d-81b2-4784-9ec6-fcad13129c00', '0824e76e-420e-4d13-b193-3b4f408d8238'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7f581d28-20da-44de-9af8-ab541583e002 tempest-CreateVolumesFromSnapshotTest-444275415 None] Create snapshot completed successfully Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740535f-bb24-400f-9f22-e410153fe221]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:49 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:49 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:49 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 Jul 31 11:02:49 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:50 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.273s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:50 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Deleted volume successfully. Jul 31 11:02:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-214be9f0-1afd-460d-abe9-961f921afa4d tempest-VolumesTransfersV355Test-1796808942 None] Lock "cinder-7d73ae29-cd7d-483f-b4e4-8ffdbac65f4b-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:50 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" returned: 0 in 0.450s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.476s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f64ce749-ba58-460e-9328-297435ec03f8', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:02:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-9a68d7bc-04ae-466d-b9c0-ad649800e986 req-8e6f4d98-7b95-4e2e-837d-4b750a5b63bc tempest-TestInstancesWithCinderVolumes-2093238447 None] attachment_update completed successfully. Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (59cfa1bc-de63-4a25-96a5-3c2097442298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c01575f-0743-4749-97ff-c40267e93874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c01575f-0743-4749-97ff-c40267e93874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902833933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fe8c0e-ab74-40bc-a00f-d862810debaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:51Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21794def-c3b5-46c1-8a3d-7be02c68f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21794def-c3b5-46c1-8a3d-7be02c68f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfcf897-5cb3-4fd1-beab-aae9db9f79d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfcf897-5cb3-4fd1-beab-aae9db9f79d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fe8c0e-ab74-40bc-a00f-d862810debaf', 'volume_name': 'volume-68fe8c0e-ab74-40bc-a00f-d862810debaf', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e1e29b-3bb6-4e1b-a94d-965fc7fead64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e1e29b-3bb6-4e1b-a94d-965fc7fead64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da87b7b-c8e8-4d55-9cf9-000390850f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:51 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume 68fe8c0e-ab74-40bc-a00f-d862810debaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fe8c0e-ab74-40bc-a00f-d862810debaf', 'volume_size': 1} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-902833933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fe8c0e-ab74-40bc-a00f-d862810debaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:51Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating volume 68fe8c0e-ab74-40bc-a00f-d862810debaf {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:51 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:51 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf 1073741824 Jul 31 11:02:51 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (473a0484-6b33-4d65-a0bd-5c58fa4b78be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0aa8ba-f3b8-4f37-a034-519aea4b709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0aa8ba-f3b8-4f37-a034-519aea4b709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-158225702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c4d7df-93f1-4b13-9d6e-73468c910a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:52Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d06af2-e189-4e92-ae9b-33c8cb4c6ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d06af2-e189-4e92-ae9b-33c8cb4c6ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7ef1ec-2631-47a6-a113-ca2514b3bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7ef1ec-2631-47a6-a113-ca2514b3bc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c4d7df-93f1-4b13-9d6e-73468c910a84', 'volume_name': 'volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71826b38-7a46-43ef-88c3-f20ea006ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71826b38-7a46-43ef-88c3-f20ea006ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d45588-c773-46e5-8cb1-eb4b22584c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume c3c4d7df-93f1-4b13-9d6e-73468c910a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84', 'volume_size': 1} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:52 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf 1073741824" returned: 0 in 0.802s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (5d93376f-9c84-4477-be2e-bffd7a4c3ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285eda38-f7f8-4cd9-9ab5-f138d3b6f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285eda38-f7f8-4cd9-9ab5-f138d3b6f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2138434099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3631dd8f-355d-417d-b541-0a9e67fcba0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:52Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d0ae8c-47b2-45dd-a621-90de87e3d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d0ae8c-47b2-45dd-a621-90de87e3d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26a810c-1529-45ad-85b7-35df5d5f9457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26a810c-1529-45ad-85b7-35df5d5f9457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3631dd8f-355d-417d-b541-0a9e67fcba0a', 'volume_name': 'volume-3631dd8f-355d-417d-b541-0a9e67fcba0a', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f2dd11-a4f6-406d-86c9-61de345bb5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f2dd11-a4f6-406d-86c9-61de345bb5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a64daf-29a4-4cd3-ad61-fd91b27d7a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume 3631dd8f-355d-417d-b541-0a9e67fcba0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3631dd8f-355d-417d-b541-0a9e67fcba0a', 'volume_size': 1} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:52 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf Jul 31 11:02:52 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:53 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf" returned: 0 in 0.425s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-158225702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c4d7df-93f1-4b13-9d6e-73468c910a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:52Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating volume c3c4d7df-93f1-4b13-9d6e-73468c910a84 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:53 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da87b7b-c8e8-4d55-9cf9-000390850f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fe8c0e-ab74-40bc-a00f-d862810debaf', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc65f59-5767-4837-81d4-25eb6cea6c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 1073741824 Jul 31 11:02:53 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume volume-68fe8c0e-ab74-40bc-a00f-d862810debaf (68fe8c0e-ab74-40bc-a00f-d862810debaf): created successfully Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc65f59-5767-4837-81d4-25eb6cea6c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (59cfa1bc-de63-4a25-96a5-3c2097442298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6c7cdfdd-c4eb-4a5d-b02e-037a9f679d4c tempest-CreateVolumesFromSnapshotTest-444275415 None] Created volume successfully. Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (172c5085-75e3-4022-a3b1-e31da74294ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8667663-364d-45a8-8278-0e3638070fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8667663-364d-45a8-8278-0e3638070fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165263253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d622d6-10e8-4131-8747-f047f3d1559f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:53Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe18afd-ae35-4a3d-8155-1afea9dcb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe18afd-ae35-4a3d-8155-1afea9dcb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b71ab68-95d6-408d-a404-a38c49df7632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b71ab68-95d6-408d-a404-a38c49df7632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d622d6-10e8-4131-8747-f047f3d1559f', 'volume_name': 'volume-d5d622d6-10e8-4131-8747-f047f3d1559f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47290257-1603-4c28-9bb7-aed08916ee7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47290257-1603-4c28-9bb7-aed08916ee7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb449910-4661-4ff4-875c-76f5e82002de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume d5d622d6-10e8-4131-8747-f047f3d1559f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d622d6-10e8-4131-8747-f047f3d1559f', 'volume_size': 1} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (f2ec68aa-33df-4506-be42-2a9f285cd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9602f6e1-09f0-46a0-86df-94839813c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9602f6e1-09f0-46a0-86df-94839813c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2029782027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa6f560-af66-4f67-885b-b7bfe0245808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:54Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce8a234-ee0f-4d29-a3c5-b7fdad271e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce8a234-ee0f-4d29-a3c5-b7fdad271e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b3ff8f-8234-4080-963e-da487172aa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b3ff8f-8234-4080-963e-da487172aa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa6f560-af66-4f67-885b-b7bfe0245808', 'volume_name': 'volume-7fa6f560-af66-4f67-885b-b7bfe0245808', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5183d76e-c0dc-43f3-888d-8b66165850aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5183d76e-c0dc-43f3-888d-8b66165850aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d8f7c6-6815-4ebb-b06a-8da0be462553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume 7fa6f560-af66-4f67-885b-b7bfe0245808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa6f560-af66-4f67-885b-b7bfe0245808', 'volume_size': 1} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 1073741824" returned: 0 in 0.822s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:53 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 Jul 31 11:02:54 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "cinder-a4a52001-68dc-4135-b9fc-a87a8217fac7-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-a4a52001-68dc-4135-b9fc-a87a8217fac7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:54 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84" returned: 0 in 0.306s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2138434099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3631dd8f-355d-417d-b541-0a9e67fcba0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:52Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating volume 3631dd8f-355d-417d-b541-0a9e67fcba0a {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:54 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d45588-c773-46e5-8cb1-eb4b22584c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:54 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a 1073741824 Jul 31 11:02:54 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d540aa8-c943-4c25-add9-2312d5cc5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "cinder-quobyte-a4a52001-68dc-4135-b9fc-a87a8217fac7" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 (c3c4d7df-93f1-4b13-9d6e-73468c910a84): created successfully Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d540aa8-c943-4c25-add9-2312d5cc5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (473a0484-6b33-4d65-a0bd-5c58fa4b78be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-quobyte-a4a52001-68dc-4135-b9fc-a87a8217fac7" acquired by "delete_volume" :: waited 0.040s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8ca15772-33b4-4916-ba8d-a36afe6f4976 tempest-CreateVolumesFromSnapshotTest-444275415 None] Created volume successfully. Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0443a0-6126-4574-a162-81624e671001]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:54 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 Jul 31 11:02:54 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:54 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7" returned: 0 in 0.413s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:54 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7 Jul 31 11:02:54 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:54 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a 1073741824" returned: 0 in 0.597s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:54 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a Jul 31 11:02:54 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:55 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a4a52001-68dc-4135-b9fc-a87a8217fac7" returned: 0 in 0.309s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-quobyte-a4a52001-68dc-4135-b9fc-a87a8217fac7" released by "delete_volume" :: held 0.780s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:55 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-165263253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d622d6-10e8-4131-8747-f047f3d1559f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:53Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating volume d5d622d6-10e8-4131-8747-f047f3d1559f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:55 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a64daf-29a4-4cd3-ad61-fd91b27d7a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3631dd8f-355d-417d-b541-0a9e67fcba0a', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:55 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f 1073741824 Jul 31 11:02:55 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772c8e78-5986-4ebe-9f14-23188412f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume volume-3631dd8f-355d-417d-b541-0a9e67fcba0a (3631dd8f-355d-417d-b541-0a9e67fcba0a): created successfully Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772c8e78-5986-4ebe-9f14-23188412f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (5d93376f-9c84-4477-be2e-bffd7a4c3ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0cfd09d8-c49c-4098-b75a-33334921ab9d tempest-CreateVolumesFromSnapshotTest-444275415 None] Created volume successfully. Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Created reservations ['4cccbaaf-6880-48b3-974f-39e81e291216', 'e5d3a55f-b3c2-455c-a229-be3490c010d0', '2095a6bb-d7b5-4c34-8020-b3b8a3233a9e', '6df211f2-13c0-48f7-9243-02d5f7a335c7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:55 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:55 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:55 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.283s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Deleted volume successfully. Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c524dd6e-0287-4361-bfa3-298a55fafab0 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-a4a52001-68dc-4135-b9fc-a87a8217fac7-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:55 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f 1073741824" returned: 0 in 0.571s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:55 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f Jul 31 11:02:55 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:56 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f" returned: 0 in 0.273s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.598s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb449910-4661-4ff4-875c-76f5e82002de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d622d6-10e8-4131-8747-f047f3d1559f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1322dcce-43f5-4a53-92a0-2a7c8f6820b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e6715-112a-4c45-8b3d-e8bbffa053eb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume volume-d5d622d6-10e8-4131-8747-f047f3d1559f (d5d622d6-10e8-4131-8747-f047f3d1559f): created successfully Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1322dcce-43f5-4a53-92a0-2a7c8f6820b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (172c5085-75e3-4022-a3b1-e31da74294ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-26c79cf0-49d7-4556-bcff-c0edb26126c7 tempest-CreateVolumesFromSnapshotTest-444275415 None] Created volume successfully. Jul 31 11:02:56 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b Jul 31 11:02:56 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "cinder-821d70ae-febe-44e1-8f48-8fa6af54483d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-821d70ae-febe-44e1-8f48-8fa6af54483d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:56 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" returned: 0 in 0.408s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.432s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.633s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2029782027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa6f560-af66-4f67-885b-b7bfe0245808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76afd10415794235b13bdaef1812fe03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:54Z,use_quota=True,user_id='9421cd0df8c347e3bd717284490944fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Creating volume 7fa6f560-af66-4f67-885b-b7bfe0245808 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "cinder-quobyte-821d70ae-febe-44e1-8f48-8fa6af54483d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:56 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 1073741824 Jul 31 11:02:56 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-quobyte-821d70ae-febe-44e1-8f48-8fa6af54483d" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7593f18c-151f-441c-bdf8-db87497bc6f3', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643edcf-4e83-49b0-9f41-dd5e0c7d0a5c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-290f24a0-c3f7-4311-a406-73da957d4517 req-b84cf48f-f8c1-457d-b9e3-c7e264be37b4 tempest-TestInstancesWithCinderVolumes-2093238447 None] attachment_update completed successfully. Jul 31 11:02:56 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d Jul 31 11:02:56 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:57 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:57 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 1073741824" returned: 0 in 0.555s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:57 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d Jul 31 11:02:57 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:57 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 Jul 31 11:02:57 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:57 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808" returned: 0 in 0.290s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:57 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d8f7c6-6815-4ebb-b06a-8da0be462553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa6f560-af66-4f67-885b-b7bfe0245808', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abe2527-6bdb-4469-a958-a60b9b2ebb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-821d70ae-febe-44e1-8f48-8fa6af54483d" returned: 0 in 0.408s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Volume volume-7fa6f560-af66-4f67-885b-b7bfe0245808 (7fa6f560-af66-4f67-885b-b7bfe0245808): created successfully Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4abe2527-6bdb-4469-a958-a60b9b2ebb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Flow 'volume_create_manager' (f2ec68aa-33df-4506-be42-2a9f285cd456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-quobyte-821d70ae-febe-44e1-8f48-8fa6af54483d" released by "delete_volume" :: held 0.929s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-07c33484-4ba6-472d-8044-b7d68259fa0c tempest-CreateVolumesFromSnapshotTest-444275415 None] Created volume successfully. Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Created reservations ['f219bb03-5a18-4952-8640-48167b8a71e3', '03f3e742-567d-426a-a336-a5445c84d97d', '02cfed98-4330-4244-9825-a702386d44d3', '1f1c5d33-4b47-4438-8ca5-f50597116896'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:57 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:57 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:58 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.312s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Deleted volume successfully. Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7e941920-45e2-4aaf-ad8a-12e453ef51e1 tempest-TestServerVolumeAttachmentScenario-912017064 None] Lock "cinder-821d70ae-febe-44e1-8f48-8fa6af54483d-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (4ba862ca-0b7e-4a89-9bcf-6ae3631e170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84af71b-bb03-4a53-b455-06e89dfd5de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84af71b-bb03-4a53-b455-06e89dfd5de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340354569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4913a7c3-34bf-4702-94dc-053a57d72be9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:58Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42063ef3-e0da-47b8-91bc-1978cfea4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42063ef3-e0da-47b8-91bc-1978cfea4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ecf15c-3629-475e-9315-8c690816bb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ecf15c-3629-475e-9315-8c690816bb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4913a7c3-34bf-4702-94dc-053a57d72be9', 'volume_name': 'volume-4913a7c3-34bf-4702-94dc-053a57d72be9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e723ee-cbe1-4f6a-849a-05169da392b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e723ee-cbe1-4f6a-849a-05169da392b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604c8620-7137-4024-810a-edd1fbd42f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:58 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Volume 4913a7c3-34bf-4702-94dc-053a57d72be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4913a7c3-34bf-4702-94dc-053a57d72be9', 'volume_size': 1} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340354569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4913a7c3-34bf-4702-94dc-053a57d72be9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:02:58Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Creating volume 4913a7c3-34bf-4702-94dc-053a57d72be9 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:02:58 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-7fa6f560-af66-4f67-885b-b7bfe0245808-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-7fa6f560-af66-4f67-885b-b7bfe0245808-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:58 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 1073741824 Jul 31 11:02:58 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-7fa6f560-af66-4f67-885b-b7bfe0245808" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-7fa6f560-af66-4f67-885b-b7bfe0245808" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaf365c-b903-433f-a582-442f884df08a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:58 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 Jul 31 11:02:58 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:58 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 1073741824" returned: 0 in 0.566s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:59 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 Jul 31 11:02:59 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:59 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808 Jul 31 11:02:59 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9" returned: 0 in 0.290s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:59 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604c8620-7137-4024-810a-edd1fbd42f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4913a7c3-34bf-4702-94dc-053a57d72be9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31e5f37-14b3-43e6-be68-c7ec5e295971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7fa6f560-af66-4f67-885b-b7bfe0245808" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-7fa6f560-af66-4f67-885b-b7bfe0245808" released by "delete_volume" :: held 0.807s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:02:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Volume volume-4913a7c3-34bf-4702-94dc-053a57d72be9 (4913a7c3-34bf-4702-94dc-053a57d72be9): created successfully Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31e5f37-14b3-43e6-be68-c7ec5e295971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (4ba862ca-0b7e-4a89-9bcf-6ae3631e170f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:02:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3e8d519b-6dcb-40b8-bb35-8f5f60204a67 tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['30966ae9-7208-44b7-acb3-bbedfde33227', '39e35c4d-72c3-4165-be98-2e2bdc1d5ac0', '61def955-59da-4c01-8418-3f61b9cfb5b0', 'b3dc3324-2707-45c7-b5cb-f6f17fa8f1f6'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:59 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:02:59 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-d5d622d6-10e8-4131-8747-f047f3d1559f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-d5d622d6-10e8-4131-8747-f047f3d1559f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-d5d622d6-10e8-4131-8747-f047f3d1559f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-d5d622d6-10e8-4131-8747-f047f3d1559f" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2948919a-add8-4624-a3a6-ceff00ec85c6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:02:59 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 31 11:02:59 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f Jul 31 11:02:59 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.384s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:02:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleted volume successfully. Jul 31 11:02:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7697aaae-22d8-4ada-95ff-3ce69065783c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-7fa6f560-af66-4f67-885b-b7bfe0245808-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:00 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f" returned: 0 in 0.437s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:00 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f Jul 31 11:03:00 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:00 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d5d622d6-10e8-4131-8747-f047f3d1559f" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-d5d622d6-10e8-4131-8747-f047f3d1559f" released by "delete_volume" :: held 0.832s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['5687c563-c7ad-45f1-adee-b32707257130', 'fb7a4e94-a84e-4f4b-96ce-478aeebeda4c', 'cbecd976-5476-49e0-ad22-b8319baed8b6', '5b35da1e-3b67-4e19-b7b3-736ec3652ebd'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:00 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:00 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-3631dd8f-355d-417d-b541-0a9e67fcba0a-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-3631dd8f-355d-417d-b541-0a9e67fcba0a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-3631dd8f-355d-417d-b541-0a9e67fcba0a" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-3631dd8f-355d-417d-b541-0a9e67fcba0a" acquired by "delete_volume" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[310cda95-80dd-4861-96b0-2413e50095bb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:01 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.351s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleted volume successfully. Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-50bc60db-4b64-4b59-9a30-7216c47e96ce tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-d5d622d6-10e8-4131-8747-f047f3d1559f-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:01 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a Jul 31 11:03:01 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (58c6eec4-d942-447d-842e-fc8ab5535134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f21e08-5fe2-419e-b076-57c5eadd01d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f21e08-5fe2-419e-b076-57c5eadd01d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-899431959',display_name='tempest-VolumesGetTest-Volume-428364366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e48d79d-e91a-4d8f-8db5-2f92e74e65f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:01Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313c5d1e-1aaf-41b1-a99e-a45081b7b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313c5d1e-1aaf-41b1-a99e-a45081b7b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6acede-34ac-4a3f-99f9-3d47fa83be70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6acede-34ac-4a3f-99f9-3d47fa83be70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e48d79d-e91a-4d8f-8db5-2f92e74e65f4', 'volume_name': 'volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9fd987-36a9-4168-8341-9cd79e523dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9fd987-36a9-4168-8341-9cd79e523dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9c9a64-de66-4db5-9cfa-9894620ce0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Volume 1e48d79d-e91a-4d8f-8db5-2f92e74e65f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4', 'volume_size': 1} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-899431959',display_name='tempest-VolumesGetTest-Volume-428364366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e48d79d-e91a-4d8f-8db5-2f92e74e65f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:01Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Creating volume 1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:01 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:01 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 1073741824 Jul 31 11:03:01 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:01 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a" returned: 0 in 0.725s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:01 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a Jul 31 11:03:01 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:01 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3631dd8f-355d-417d-b541-0a9e67fcba0a" returned: 0 in 0.292s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-3631dd8f-355d-417d-b541-0a9e67fcba0a" released by "delete_volume" :: held 1.077s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['9f048b76-9e01-4a13-a1d7-de559c350b5a', 'e8382dd6-b457-4066-8e21-61e36f2d3ccc', '87bb0a9e-6c14-40d9-8f31-c1f0c63ffdcf', '2a4b529f-829f-419c-ad65-d18e67d897c0'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:02 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:02 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:02 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 1073741824" returned: 0 in 0.574s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:02 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 Jul 31 11:03:02 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:02 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.511s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleted volume successfully. Jul 31 11:03:02 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4" returned: 0 in 0.409s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9c9a64-de66-4db5-9cfa-9894620ce0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790ca184-3cc6-4ad2-86be-19d0066f5a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4d98fca5-07f3-4edb-ac22-b56213ac7ce8 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-3631dd8f-355d-417d-b541-0a9e67fcba0a-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:02 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Volume volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 (1e48d79d-e91a-4d8f-8db5-2f92e74e65f4): created successfully Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790ca184-3cc6-4ad2-86be-19d0066f5a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (58c6eec4-d942-447d-842e-fc8ab5535134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9c91b2fb-d7d6-4c25-86fd-7489c7b3583a tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-c3c4d7df-93f1-4b13-9d6e-73468c910a84-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-c3c4d7df-93f1-4b13-9d6e-73468c910a84-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-c3c4d7df-93f1-4b13-9d6e-73468c910a84" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-c3c4d7df-93f1-4b13-9d6e-73468c910a84" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-dbec9f0d-aab2-48ab-ab43-585dc0d5cf8e req-be9d4c4c-2255-4500-bb97-dce63e777f86 tempest-TestInstancesWithCinderVolumes-2093238447 None] Terminate volume connection completed successfully. Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-dbec9f0d-aab2-48ab-ab43-585dc0d5cf8e req-be9d4c4c-2255-4500-bb97-dce63e777f86 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deleting attachment f64ce749-ba58-460e-9328-297435ec03f8. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6a568-be81-4cda-8cb7-3bce979aa25a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 Jul 31 11:03:03 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:03 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84" returned: 0 in 0.417s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84 Jul 31 11:03:03 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Lock "cinder-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "cinder-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c42dbd-fc18-45e3-8b9b-0099c98260d9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "cinder-quobyte-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-quobyte-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:03 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c3c4d7df-93f1-4b13-9d6e-73468c910a84" returned: 0 in 0.362s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:03 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 Jul 31 11:03:03 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b686f6c-ca1e-47ea-8728-fefb0a562111]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-c3c4d7df-93f1-4b13-9d6e-73468c910a84" released by "delete_volume" :: held 0.845s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['e5ab6bc5-1c42-4bc1-9a28-5595c8c89611', '7c1cdba0-feaf-43ca-af1e-71be30651589', '3a30ee9a-bf4f-4304-9e2b-7712b036e3dc', 'a890113f-2367-4315-8f18-d577cd5261db'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:04 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 Jul 31 11:03:04 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:04 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-68fe8c0e-ab74-40bc-a00f-d862810debaf-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4" returned: 0 in 0.558s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-68fe8c0e-ab74-40bc-a00f-d862810debaf-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:04 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4 Jul 31 11:03:04 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-68fe8c0e-ab74-40bc-a00f-d862810debaf" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-68fe8c0e-ab74-40bc-a00f-d862810debaf" acquired by "delete_volume" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a7818-14f5-4a92-a64f-a62dcfbf3bd6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" returned: 0 in 0.699s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:04 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86 Jul 31 11:03:04 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4" returned: 0 in 0.342s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.512s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4" released by "delete_volume" :: held 0.986s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleted volume successfully. Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1b8d05ff-b478-46dd-baf3-a23e54e81cab tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-c3c4d7df-93f1-4b13-9d6e-73468c910a84-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:04 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf Jul 31 11:03:04 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:04 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Created reservations ['a90280ef-1923-41c3-809c-eff16321068a', '67a68f49-44a7-49b3-9e1f-ad8af175aa16', 'c8be7782-9f5d-44d8-ad86-f92c1ef3b592', '14978728-5bac-4c3c-bdde-138347b698e0'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" returned: 0 in 0.344s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-quobyte-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86" released by "delete_volume" :: held 1.115s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:05 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack cinder-volume[88837]: WARNING cinder.quota [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-694007812-1795823615 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-694007812-1795823615, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:05 devstack cinder-volume[88837]: WARNING cinder.quota [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-694007812-1795823615 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-694007812-1795823615, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Created reservations ['e98415b4-d11a-47d0-8b55-68bae709daff', 'b4765561-0ada-470e-a546-9d86970f95ef', '2ba8a8cc-0633-41fa-8521-ef78ad140508', '5b0b9bf4-22b4-4ec5-8ef3-0d972891ab39'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.301s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf" returned: 0 in 0.702s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:05 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:05 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf Jul 31 11:03:05 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a0392e1b-613a-4435-8417-ecb2e4933c49 tempest-VolumesGetTest-1868828259 None] Lock "cinder-1e48d79d-e91a-4d8f-8db5-2f92e74e65f4-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:05 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.306s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deleted volume successfully. Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-795c559a-c534-4cd7-813d-0cd49ae78c80 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-8e02c9cc-2e7f-4f82-9d96-fb00507c7f86-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:05 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-68fe8c0e-ab74-40bc-a00f-d862810debaf" returned: 0 in 0.344s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-68fe8c0e-ab74-40bc-a00f-d862810debaf" released by "delete_volume" :: held 1.127s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['467d32de-743c-429e-b726-4bb6a4708486', 'e17c334d-441b-496a-bd6f-09952305f40b', '59d232ab-7e19-4de8-8ba0-bf73b664168b', 'f4f28e5f-e779-41b0-b203-6034251230ef'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:05 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:05 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-4913a7c3-34bf-4702-94dc-053a57d72be9-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Lock "cinder-4913a7c3-34bf-4702-94dc-053a57d72be9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:06 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.370s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-4913a7c3-34bf-4702-94dc-053a57d72be9" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleted volume successfully. Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-4913a7c3-34bf-4702-94dc-053a57d72be9" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6a272653-1817-425f-aa9d-377b99c0e05c tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-68fe8c0e-ab74-40bc-a00f-d862810debaf-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b3e01-497e-474c-b69b-563d07066b42]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:06 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 Jul 31 11:03:06 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-3434cd88-d350-4b0a-8c23-9026becaec68-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:06 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9" returned: 0 in 0.440s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-3434cd88-d350-4b0a-8c23-9026becaec68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-619b3db1-c9ff-4200-bf0b-669278e0ad49" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:06 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9 Jul 31 11:03:06 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-619b3db1-c9ff-4200-bf0b-669278e0ad49" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-3434cd88-d350-4b0a-8c23-9026becaec68" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-3434cd88-d350-4b0a-8c23-9026becaec68" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleting offline snapshot 3434cd88-d350-4b0a-8c23-9026becaec68 of volume 619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] snapshot_file for this snap is: volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd8ccc8-de5b-419c-913e-68996871d4fc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:07 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 Jul 31 11:03:07 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:07 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4913a7c3-34bf-4702-94dc-053a57d72be9" returned: 0 in 0.454s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-4913a7c3-34bf-4702-94dc-053a57d72be9" released by "delete_volume" :: held 0.965s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Created reservations ['25bbd6fa-7508-4b90-bd9b-523aaa004b05', 'f963d76d-9ce1-40cc-a817-29bc6914a29c', '5821be0f-97ee-44a5-b0dc-b792cbf94699', '61ca7d2a-2368-4d39-9f21-315d0d4a2738'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:07 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:07 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:07 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68" returned: 0 in 0.584s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619b3db1-c9ff-4200-bf0b-669278e0ad49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef527fe-f6d6-4502-ad64-4350f4d4f5bb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:07 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 Jul 31 11:03:07 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:07 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.351s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7f4e5d49-286c-416f-9a41-2fa54e891d25 tempest-VolumesGetTest-1868828259 None] Lock "cinder-4913a7c3-34bf-4702-94dc-053a57d72be9-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:08 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49" returned: 0 in 0.472s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:08 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 Jul 31 11:03:08 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:08 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68" returned: 0 in 0.438s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:08 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68 Jul 31 11:03:08 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:08 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49.3434cd88-d350-4b0a-8c23-9026becaec68" returned: 0 in 0.284s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-3434cd88-d350-4b0a-8c23-9026becaec68" released by "_delete_snapshot" :: held 1.964s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-74c83d5b-e684-4674-8aed-6144e24599b3 req-8e190c9e-edfd-4e3f-9428-e685d3ad7242 tempest-TestInstancesWithCinderVolumes-2093238447 None] Terminate volume connection completed successfully. Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-74c83d5b-e684-4674-8aed-6144e24599b3 req-8e190c9e-edfd-4e3f-9428-e685d3ad7242 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deleting attachment 7593f18c-151f-441c-bdf8-db87497bc6f3. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-619b3db1-c9ff-4200-bf0b-669278e0ad49" released by "delete_snapshot" :: held 2.028s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:08 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['b3672d5f-ed8b-4f67-8e4c-9c668354e170', 'dd341139-8f69-4cda-a844-864083c20126', '8922c2ef-013e-4923-81b7-875e38f9c4e1', 'dc1fb88a-27eb-426f-8d5f-25c9cd7b5b15'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Delete snapshot completed successfully. Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4eda741-2f77-43c2-b92c-81d6bf851fff tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-3434cd88-d350-4b0a-8c23-9026becaec68-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (a44647e0-ca9f-41a1-819e-0ae6dcf20023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a9620f-095a-4d5e-8e89-ebab2fe97e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a9620f-095a-4d5e-8e89-ebab2fe97e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1008313280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc717f5a-32aa-48e9-8b16-ad09ff8bcff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:09Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67c606a-d6a0-4dbb-ac9b-806b3f4d99d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67c606a-d6a0-4dbb-ac9b-806b3f4d99d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846d9da6-f0ae-4b99-994e-8a3b967015c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846d9da6-f0ae-4b99-994e-8a3b967015c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'volume_name': 'volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94fdf11-dcb9-4c70-aacf-3d88eab7f343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94fdf11-dcb9-4c70-aacf-3d88eab7f343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e7dad6-3362-45f5-a3b1-d1934fdfb435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Volume bc717f5a-32aa-48e9-8b16-ad09ff8bcff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'volume_size': 1} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1008313280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc717f5a-32aa-48e9-8b16-ad09ff8bcff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:09Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Creating volume bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:09 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:09 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 1073741824 Jul 31 11:03:09 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "cinder-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "cinder-quobyte-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-quobyte-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f454d-64c2-4c90-bff0-ab581ae733ef]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:09 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b Jul 31 11:03:09 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:09 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 1073741824" returned: 0 in 0.653s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:10 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:10 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-619b3db1-c9ff-4200-bf0b-669278e0ad49-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-619b3db1-c9ff-4200-bf0b-669278e0ad49-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:10 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" returned: 0 in 0.576s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:10 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b Jul 31 11:03:10 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "cinder-quobyte-619b3db1-c9ff-4200-bf0b-669278e0ad49" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-619b3db1-c9ff-4200-bf0b-669278e0ad49" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0e0f7e-5c20-4923-a9dd-030a1ebfb8c7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:10 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.384s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e7dad6-3362-45f5-a3b1-d1934fdfb435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2ac216-17db-4514-850c-7989777fc186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:10 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Volume volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 (bc717f5a-32aa-48e9-8b16-ad09ff8bcff2): created successfully Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2ac216-17db-4514-850c-7989777fc186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (a44647e0-ca9f-41a1-819e-0ae6dcf20023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:10 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 Jul 31 11:03:10 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-68212e41-4f45-4537-9c93-2c010ca71f02 tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:03:10 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-quobyte-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b" released by "delete_volume" :: held 1.137s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:10 devstack cinder-volume[88837]: WARNING cinder.quota [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56677276-1017924809 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56677276-1017924809, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:10 devstack cinder-volume[88837]: WARNING cinder.quota [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56677276-1017924809 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-56677276-1017924809, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Created reservations ['4f3a05e3-f3c7-407d-9241-fa4e069891f6', 'c04c8c2c-e499-4538-9e15-a6a814ca89df', 'f4524fa4-1370-4e1d-b485-5872617ffa39', '2b48efab-353e-4e37-b483-c28cde29b1c4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:10 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49" returned: 0 in 0.540s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:10 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:10 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:10 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49 Jul 31 11:03:10 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:11 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.342s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:11 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-619b3db1-c9ff-4200-bf0b-669278e0ad49" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Deleted volume successfully. Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-quobyte-619b3db1-c9ff-4200-bf0b-669278e0ad49" released by "delete_volume" :: held 1.013s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e9402fdf-5bdf-42d1-b942-1d705492a0ba tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-6ea6449e-fdad-4ccf-b37b-be14a0fe9e5b-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Created reservations ['64ec8f29-597f-41e4-93dc-46e32267260c', '4b257f2a-54c4-4317-b410-d29ff47112c1', '52deddbd-69dd-43eb-8c12-54a337fc6d88', 'de339551-f054-42ef-8b0f-5ecddc9b54cc'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:11 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:11 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:11 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.400s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Deleted volume successfully. Jul 31 11:03:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-21e4eaae-ece7-4132-b16c-68a101514850 tempest-CreateVolumesFromSnapshotTest-444275415 None] Lock "cinder-619b3db1-c9ff-4200-bf0b-669278e0ad49-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (b1ff38d2-b3b7-47fc-856f-6ba74452a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf70f7a-f948-4110-9bf3-f0a28b163478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf70f7a-f948-4110-9bf3-f0a28b163478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1877904964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e147ace4-e260-4d85-9164-3803958a1c88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bc717f5a-32aa-48e9-8b16-ad09ff8bcff2,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:12Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb2d48b-d708-4788-8e31-691335b21667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb2d48b-d708-4788-8e31-691335b21667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dfa876f-3ddc-416e-a4ce-a5b213ed76f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dfa876f-3ddc-416e-a4ce-a5b213ed76f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e147ace4-e260-4d85-9164-3803958a1c88', 'volume_name': 'volume-e147ace4-e260-4d85-9164-3803958a1c88', 'volume_size': 1, 'source_volid': 'bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'source_volstatus': 'available'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c5c55f-d5bf-4b35-93c6-ea9f0fac91c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c5c55f-d5bf-4b35-93c6-ea9f0fac91c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9d2cca-b38d-4795-a93f-115f26330520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:12 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Volume e147ace4-e260-4d85-9164-3803958a1c88: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e147ace4-e260-4d85-9164-3803958a1c88', 'volume_size': 1, 'source_volid': 'bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'source_volstatus': 'available'} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:12 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Cloning volume bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 to volume e147ace4-e260-4d85-9164-3803958a1c88 Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Creating offline snapshot d1fffc8a-124d-47ac-9563-01d7469f44e2 of volume bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82c8cb-bfa7-473c-b011-b325cffd24cd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:12 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:12 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:12 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.570s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:12 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 1G Jul 31 11:03:12 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:13 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 1G" returned: 0 in 0.680s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:13 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 Jul 31 11:03:13 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:14 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2" returned: 0 in 0.552s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:14 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 is being set with open permissions: ugo+rw Jul 31 11:03:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:14 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 Jul 31 11:03:14 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:14 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2" returned: 0 in 0.398s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:14 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info Jul 31 11:03:14 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:14 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:14 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info is being set with open permissions: ugo+rw Jul 31 11:03:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:15 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info Jul 31 11:03:15 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:15 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.info" returned: 0 in 0.360s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-e147ace4-e260-4d85-9164-3803958a1c88" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-e147ace4-e260-4d85-9164-3803958a1c88" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] snapshot: d1fffc8a-124d-47ac-9563-01d7469f44e2, volume: e147ace4-e260-4d85-9164-3803958a1c88, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fb96f8-59bc-4095-becf-9d8db141fb63]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:15 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 Jul 31 11:03:15 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:16 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2" returned: 0 in 0.611s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:03:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-2997b45d-600e-4d50-a846-61312732f904 req-922da0b9-5b26-4e7e-820f-74f98c611d99 tempest-TestInstancesWithCinderVolumes-2093238447 None] Terminate volume connection completed successfully. Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-2997b45d-600e-4d50-a846-61312732f904 req-922da0b9-5b26-4e7e-820f-74f98c611d99 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deleting attachment 68548d93-a01d-4cdd-a536-f2a136dc3708. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b775e58a-4f1a-4031-a118-217ce4e4ed73]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:16 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:16 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:16 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.600s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:03:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:16 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 Jul 31 11:03:16 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Flow 'volume_create_manager' (c5236a9e-f37b-4a81-b3ad-6b210d50d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b273cd-a2b5-4f2b-8051-97b990649133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b273cd-a2b5-4f2b-8051-97b990649133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1450114245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb59e2b6-6c85-4126-83d6-0bce14c9c436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e21e088da4d37bba9a07e09aea1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:17Z,use_quota=True,user_id='9f592d0a11554873865220d476040fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6475c7-8568-4edb-b453-4c6924884569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6475c7-8568-4edb-b453-4c6924884569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871430f4-ad43-4c45-97cf-24b072e0ec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871430f4-ad43-4c45-97cf-24b072e0ec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb59e2b6-6c85-4126-83d6-0bce14c9c436', 'volume_name': 'volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef0928d-0ead-41d2-bb49-21ff76e8619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef0928d-0ead-41d2-bb49-21ff76e8619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fb1678-dba7-4b85-a94a-cb3b41c07ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:17 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Volume eb59e2b6-6c85-4126-83d6-0bce14c9c436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436', 'volume_size': 1} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "cinder-01ab832b-9179-4f5e-a155-3dc01ad8c66b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-01ab832b-9179-4f5e-a155-3dc01ad8c66b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "cinder-quobyte-01ab832b-9179-4f5e-a155-3dc01ad8c66b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-quobyte-01ab832b-9179-4f5e-a155-3dc01ad8c66b" acquired by "delete_volume" :: waited 0.056s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a80da-7ea2-42fe-9e52-e99a34f95f11]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:17 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:03:17 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:18 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 0 in 0.870s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:18 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:03:18 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:19 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 1 in 0.889s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:19 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b Jul 31 11:03:19 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:19 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-01ab832b-9179-4f5e-a155-3dc01ad8c66b" returned: 0 in 0.579s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-quobyte-01ab832b-9179-4f5e-a155-3dc01ad8c66b" released by "delete_volume" :: held 2.541s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:20 devstack cinder-volume[88837]: WARNING cinder.quota [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1905159551-667199492 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1905159551-667199492, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:20 devstack cinder-volume[88837]: WARNING cinder.quota [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1905159551-667199492 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1905159551-667199492, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Created reservations ['5197aebd-cb02-4dab-bf40-288e34045e3e', 'c211d01d-ba00-4097-9d62-31d8f16467c1', 'bd08031e-539b-4725-8a39-faa70978ef56', '1f94532f-9750-45b8-9f27-dbac5f511013'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:20 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:20 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:20 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.560s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:20 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Deleted volume successfully. Jul 31 11:03:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-af3a081e-0e4c-4c75-8445-ef16d9735582 tempest-TestInstancesWithCinderVolumes-2093238447 None] Lock "cinder-01ab832b-9179-4f5e-a155-3dc01ad8c66b-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:22 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88" returned: 0 in 5.702s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43506e-9d02-4807-adfc-fc483b9e1546]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:22 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:22 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.686s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:23 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Converted 1024.00 MB image at 179.55 MB/s Jul 31 11:03:23 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 is being set with open permissions: ugo+rw Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:23 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 Jul 31 11:03:23 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88" returned: 0 in 0.320s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-e147ace4-e260-4d85-9164-3803958a1c88" released by "_copy_volume_from_snapshot" :: held 8.070s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-d1fffc8a-124d-47ac-9563-01d7469f44e2" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-d1fffc8a-124d-47ac-9563-01d7469f44e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Deleting offline snapshot d1fffc8a-124d-47ac-9563-01d7469f44e2 of volume bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] snapshot_file for this snap is: volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a7e848-afcc-4d56-8477-f0b7aa95cd86]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:23 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 Jul 31 11:03:23 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:23 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2" returned: 0 in 0.431s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:24 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5e02ae-c0c4-4c08-a2c2-be4dea86bd46]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:24 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:24 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:24 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.536s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:24 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 Jul 31 11:03:24 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:24 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2" returned: 0 in 0.408s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:24 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2 Jul 31 11:03:24 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:25 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2.d1fffc8a-124d-47ac-9563-01d7469f44e2" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-d1fffc8a-124d-47ac-9563-01d7469f44e2" released by "_delete_snapshot" :: held 1.777s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.162s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.243s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1450114245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb59e2b6-6c85-4126-83d6-0bce14c9c436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e21e088da4d37bba9a07e09aea1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:17Z,use_quota=True,user_id='9f592d0a11554873865220d476040fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Creating volume eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:25 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:25 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 1073741824 Jul 31 11:03:25 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9d2cca-b38d-4795-a93f-115f26330520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e147ace4-e260-4d85-9164-3803958a1c88', 'volume_size': 1, 'source_volid': 'bc717f5a-32aa-48e9-8b16-ad09ff8bcff2', 'source_volstatus': 'available'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d26c3dc-5af4-43b1-b685-87dca59af287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:25 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Volume volume-e147ace4-e260-4d85-9164-3803958a1c88 (e147ace4-e260-4d85-9164-3803958a1c88): created successfully Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d26c3dc-5af4-43b1-b685-87dca59af287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (b1ff38d2-b3b7-47fc-856f-6ba74452a214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:25 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a9e99e6-8deb-4efb-9b09-63ec93ed09ed tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:03:26 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 1073741824" returned: 0 in 0.665s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:26 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:26 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:26 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fb1678-dba7-4b85-a94a-cb3b41c07ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae11dc9-a1ce-4de3-a444-c3a87a68e8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Volume volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 (eb59e2b6-6c85-4126-83d6-0bce14c9c436): created successfully Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae11dc9-a1ce-4de3-a444-c3a87a68e8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Flow 'volume_create_manager' (c5236a9e-f37b-4a81-b3ad-6b210d50d725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5f196dd6-8ddd-4bc3-9ba4-84a43b37edc5 tempest-VolumeDependencyTests-1784093296 None] Created volume successfully. Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (9462d37b-fdac-407d-bcf9-64e8cc152341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7fce56-3b90-4627-bc83-1fd2ab3f4fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7fce56-3b90-4627-bc83-1fd2ab3f4fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1473611413',display_name='tempest-VolumesGetTest-Volume-995065820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc21f46-0ae7-4b75-90ce-42bfaae78f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:27Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca10278-618a-4e72-bec0-220a72dfe86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca10278-618a-4e72-bec0-220a72dfe86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e28d0f-77b1-4a21-b93c-d46f3d820462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e28d0f-77b1-4a21-b93c-d46f3d820462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc21f46-0ae7-4b75-90ce-42bfaae78f95', 'volume_name': 'volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200549e6-2fe7-4161-bc31-14d25a137b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200549e6-2fe7-4161-bc31-14d25a137b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365de744-ca9b-40ea-bf88-985073f261f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Volume abc21f46-0ae7-4b75-90ce-42bfaae78f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95', 'volume_size': 1} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1473611413',display_name='tempest-VolumesGetTest-Volume-995065820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc21f46-0ae7-4b75-90ce-42bfaae78f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:27Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Creating volume abc21f46-0ae7-4b75-90ce-42bfaae78f95 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:26 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:26 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 1073741824 Jul 31 11:03:26 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:27 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 1073741824" returned: 0 in 0.770s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:27 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 Jul 31 11:03:27 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:27 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.495s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365de744-ca9b-40ea-bf88-985073f261f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b3e913-5efc-41ef-8733-d5bee8203d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Creating offline snapshot 5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 of volume eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:03:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Volume volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 (abc21f46-0ae7-4b75-90ce-42bfaae78f95): created successfully Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b3e913-5efc-41ef-8733-d5bee8203d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (9462d37b-fdac-407d-bcf9-64e8cc152341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d487cf-8ce6-4afc-8ecc-7e014f4c731a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c2dc7f75-2d15-49ae-bf5c-dddd1ef32bf1 tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:03:28 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:28 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:28 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.491s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:28 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 1G Jul 31 11:03:28 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-abc21f46-0ae7-4b75-90ce-42bfaae78f95-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Lock "cinder-abc21f46-0ae7-4b75-90ce-42bfaae78f95-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-abc21f46-0ae7-4b75-90ce-42bfaae78f95" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-abc21f46-0ae7-4b75-90ce-42bfaae78f95" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:29 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 1G" returned: 0 in 0.595s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0414e78-37ea-44a5-8581-9b374ecb3577]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 Jul 31 11:03:29 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 Jul 31 11:03:29 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" returned: 0 in 0.381s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 is being set with open permissions: ugo+rw Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 Jul 31 11:03:29 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95" returned: 0 in 0.518s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95 Jul 31 11:03:29 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:29 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" returned: 0 in 0.321s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:29 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info Jul 31 11:03:29 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-abc21f46-0ae7-4b75-90ce-42bfaae78f95" returned: 0 in 0.358s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-abc21f46-0ae7-4b75-90ce-42bfaae78f95" released by "delete_volume" :: held 0.954s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Created reservations ['b1766fb5-07f0-494f-a0e5-4b22b9e6cb41', '314fee31-95c9-4185-acfc-1706dcfdb22d', '7fde1927-2572-4090-8c92-8ae6fd7c9fa2', 'cd689b5c-14e5-470f-aa26-d2cf5699a48a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:30 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info" returned: 0 in 0.396s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info is being set with open permissions: ugo+rw Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:30 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:30 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info Jul 31 11:03:30 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:30 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.info" returned: 0 in 0.346s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.687s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f02c85fc-f048-4013-8a93-2930de3c6c76 tempest-VolumeDependencyTests-1784093296 None] Create snapshot completed successfully Jul 31 11:03:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-982bc4a1-4aa4-4285-9655-8376d9a1450d tempest-VolumesGetTest-1868828259 None] Lock "cinder-abc21f46-0ae7-4b75-90ce-42bfaae78f95-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-e147ace4-e260-4d85-9164-3803958a1c88-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Lock "cinder-e147ace4-e260-4d85-9164-3803958a1c88-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-e147ace4-e260-4d85-9164-3803958a1c88" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-e147ace4-e260-4d85-9164-3803958a1c88" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:31 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f216a5-01e7-4874-a5b1-700c69c3b530]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:31 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 Jul 31 11:03:31 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88" returned: 0 in 0.503s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88 Jul 31 11:03:32 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e147ace4-e260-4d85-9164-3803958a1c88" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-e147ace4-e260-4d85-9164-3803958a1c88" released by "delete_volume" :: held 0.877s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Flow 'volume_create_manager' (76b84adf-9948-4045-8c43-032aa3280c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1661fa19-c59b-4e49-bfe1-d127b62e6af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Created reservations ['1fb5ce93-49a7-427e-9e48-da13bdab6da2', '71be33a0-f85b-41d5-9252-c47b08588a85', 'c9341b46-463f-435f-b353-439bffdc2152', '57f6f8d4-047b-4247-8654-b3bb7d0c882a'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1661fa19-c59b-4e49-bfe1-d127b62e6af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-967681036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a7545e-dcc9-48af-a5d2-1042602fdfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2e21e088da4d37bba9a07e09aea1be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d3c2bd1-ecfb-41bf-8522-6abffa2ed048,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:32Z,use_quota=True,user_id='9f592d0a11554873865220d476040fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59480782-ee53-4cb9-b561-40dc4dfbdeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59480782-ee53-4cb9-b561-40dc4dfbdeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec64a9d2-a555-4c5c-81ed-b96514f1bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec64a9d2-a555-4c5c-81ed-b96514f1bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8a7545e-dcc9-48af-a5d2-1042602fdfb2', 'volume_name': 'volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2', 'volume_size': 1, 'snapshot_id': '5d3c2bd1-ecfb-41bf-8522-6abffa2ed048'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfc8196-bc10-4b67-a7e0-207b5f3d5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfc8196-bc10-4b67-a7e0-207b5f3d5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e8c210-2b4a-45f2-af41-2705b7180ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:32 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Volume f8a7545e-dcc9-48af-a5d2-1042602fdfb2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2', 'volume_size': 1, 'snapshot_id': '5d3c2bd1-ecfb-41bf-8522-6abffa2ed048'} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-quobyte-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Creating volume f8a7545e-dcc9-48af-a5d2-1042602fdfb2 from snapshot 5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-quobyte-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] snapshot: 5d3c2bd1-ecfb-41bf-8522-6abffa2ed048, volume: f8a7545e-dcc9-48af-a5d2-1042602fdfb2, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa35dcfd-b790-47b3-9cef-3c6054d93635]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:32 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:32 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:32 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 Jul 31 11:03:32 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:33 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:33 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e2b47096-6e66-4e46-914b-d42e2045e3d1 tempest-VolumesGetTest-1868828259 None] Lock "cinder-e147ace4-e260-4d85-9164-3803958a1c88-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:33 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" returned: 0 in 0.520s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a6156-32dc-49fc-b5f4-38b46355b281]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:33 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:33 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:33 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:33 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 Jul 31 11:03:33 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Lock "cinder-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e1c5a7-188d-496c-b676-b70544a8bd62]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:34 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:34 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:34 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.515s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:34 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2 Jul 31 11:03:34 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:35 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" returned: 0 in 0.800s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2" released by "delete_volume" :: held 1.425s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Created reservations ['8c78abd2-5791-42ae-a57d-8751cbe97b28', '443e04fe-d750-464c-a4c7-9afce393d7b9', 'f130d58f-5608-44f9-b67f-f40ba8d4894f', 'df7f0199-ac15-4e61-aa06-2962f16dc205'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:35 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:35 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:36 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.697s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:36 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-85e7bf52-b865-452e-9554-7309b1aea650 tempest-VolumesGetTest-1868828259 None] Lock "cinder-bc717f5a-32aa-48e9-8b16-ad09ff8bcff2-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=164,cinder:UPDATE=205,cinder:INSERT=51,cinder:DELETE=20 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=172,cinder:UPDATE=218,cinder:INSERT=47,cinder:DELETE=15 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (208c9822-f561-401b-abba-b47dc68b27e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17faec88-7b45-4131-a4f8-4746a0e77d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17faec88-7b45-4131-a4f8-4746a0e77d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-875921484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acbfb9b-1aa9-42a4-95af-fcb9de461929,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:38Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bae562-ec3d-4e53-9ec8-5c7819269dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bae562-ec3d-4e53-9ec8-5c7819269dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed75ae3-82a3-4c36-a3b2-661b84c416ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:38 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:03:39 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" returned: 0 in 6.171s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:39 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a314f69e-9372-40ff-9e20-39992f5c4075]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:40 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:40 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed75ae3-82a3-4c36-a3b2-661b84c416ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1acbfb9b-1aa9-42a4-95af-fcb9de461929', 'volume_name': 'volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dccce1-3aa7-4190-b9c6-1bb1256eff75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dccce1-3aa7-4190-b9c6-1bb1256eff75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f381a9-ecff-4812-ab77-dfd1ccbafef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Volume 1acbfb9b-1aa9-42a4-95af-fcb9de461929: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Trying to clone 1acbfb9b-1aa9-42a4-95af-fcb9de461929 from image 054f039c-e113-4ed9-900a-f72893aac763 at location (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:03:40 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Image download 20.69 MB at 20.69 MB/s Jul 31 11:03:40 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.925s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:40 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Converted 1024.00 MB image at 165.88 MB/s Jul 31 11:03:40 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 is being set with open permissions: ugo+rw Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:40 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 Jul 31 11:03:40 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7631793c-e8c8-4bd8-9871-005888515152]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:41 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD Jul 31 11:03:41 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:41 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" returned: 0 in 0.439s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" released by "_copy_volume_from_snapshot" :: held 8.705s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" released by "_create_volume_from_snapshot" :: held 8.750s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.778s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e8c210-2b4a-45f2-af41-2705b7180ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2', 'volume_size': 1, 'snapshot_id': '5d3c2bd1-ecfb-41bf-8522-6abffa2ed048'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4df958-aa1f-4257-b586-ddd95d01a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:41 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Volume volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 (f8a7545e-dcc9-48af-a5d2-1042602fdfb2): created successfully Jul 31 11:03:41 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4df958-aa1f-4257-b586-ddd95d01a06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Flow 'volume_create_manager' (76b84adf-9948-4045-8c43-032aa3280c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 is fetched for user 31a2f187497e444d969114717ff7a8c3. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:03:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fb4b3fec-370f-40ed-9661-384a874df942 tempest-VolumeDependencyTests-1784093296 None] Created volume successfully. Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bfe015-7b39-409f-b845-941cec48baca]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:41 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD Jul 31 11:03:41 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:41 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-875921484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acbfb9b-1aa9-42a4-95af-fcb9de461929,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:38Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Creating volume 1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:41 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:42 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 1073741824 Jul 31 11:03:42 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:42 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 1073741824" returned: 0 in 0.568s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:42 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:42 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-quobyte-eb59e2b6-6c85-4126-83d6-0bce14c9c436" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-eb59e2b6-6c85-4126-83d6-0bce14c9c436" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-quobyte-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Deleting offline snapshot 5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 of volume eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] snapshot_file for this snap is: volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab9966-7e27-4055-a48a-15f035977921]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:42 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:42 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 Jul 31 11:03:42 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 0 in 0.395s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Attempting download of 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 1acbfb9b-1aa9-42a4-95af-fcb9de461929. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae612ce-937f-49f7-b8b3-25192470b6fc]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:43 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i Jul 31 11:03:43 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:43 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" returned: 0 in 0.605s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1374c6-f755-411d-8709-535f6f2779b6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:43 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i" returned: 0 in 0.409s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:43 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:43 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:43 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i Jul 31 11:03:43 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:44 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.611s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:44 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 Jul 31 11:03:44 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:44 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i" returned: 1 in 0.577s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_pademm0i' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b12202-4e39-45c6-af4d-2e327ae6453f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:44 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD Jul 31 11:03:44 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:44 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" returned: 0 in 0.446s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:44 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048 Jul 31 11:03:44 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:44 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] 054f039c-e113-4ed9-900a-f72893aac763 was qcow2, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:44 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:44 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:44 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436.5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" returned: 0 in 0.339s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048" released by "_delete_snapshot" :: held 2.182s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-eb59e2b6-6c85-4126-83d6-0bce14c9c436" released by "delete_snapshot" :: held 2.227s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:45 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Created reservations ['e8dd4cc6-3a30-49fa-af49-c90d790ef311', 'c05c10a8-aaa5-482e-b104-203705ab37ca', 'd9731938-c955-4c02-91ad-f32c24664039', 'bc6b3684-ef95-49e4-94a7-664d2b8329de'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Delete snapshot completed successfully. Jul 31 11:03:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9d5ce987-d41a-4cc9-872f-c67c03401523 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-5d3c2bd1-ecfb-41bf-8522-6abffa2ed048-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-eb59e2b6-6c85-4126-83d6-0bce14c9c436-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-eb59e2b6-6c85-4126-83d6-0bce14c9c436-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-quobyte-eb59e2b6-6c85-4126-83d6-0bce14c9c436" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-eb59e2b6-6c85-4126-83d6-0bce14c9c436" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[49de4015-8582-4c27-a67f-ae2b0aae7330]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:46 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:46 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:46 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:46 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 0 in 1.995s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763_hta4nplpdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:46 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Converted 112.00 MB image at 56.08 MB/s Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:46 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 1G Jul 31 11:03:46 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:46 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Flow 'volume_create_manager' (1795c3dd-dfd8-4bd0-b8eb-dd604a356671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93cb706-3883-44ec-911d-d3f84bb946d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.646s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93cb706-3883-44ec-911d-d3f84bb946d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ee8ce2-22aa-4a94-8560-a55cca9c3fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6141694385d4a648a99ab2dec44ede2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:47Z,use_quota=True,user_id='7cb4ea5be4f3420ebb8670e7b2959a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d56c34c-d7c6-4b18-8638-83b4ec7a7ce7),volume_type_id=0d56c34c-d7c6-4b18-8638-83b4ec7a7ce7)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1856897d-0ef3-4435-b98b-413650e65edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1856897d-0ef3-4435-b98b-413650e65edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:46 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436 Jul 31 11:03:46 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3f7847-add5-411a-98c3-4de2586a3785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:03:46 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.382s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:03:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:03:47 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 1G" returned: 0 in 0.412s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eb59e2b6-6c85-4126-83d6-0bce14c9c436" returned: 0 in 0.357s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[845343bd-9f0d-42bf-8ded-febe579a48fc]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-eb59e2b6-6c85-4126-83d6-0bce14c9c436" released by "delete_volume" :: held 1.113s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Created reservations ['f0f03353-569b-4b09-8d95-be7f5cde7f0d', 'de209720-8f59-4bac-9380-0aa843807698', '798d9a47-106f-4525-b96c-7ef18065e79c', '5223dcfa-794a-4a57-9f8d-17b5179b43c2'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:47 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:47 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3f7847-add5-411a-98c3-4de2586a3785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34ee8ce2-22aa-4a94-8560-a55cca9c3fae', 'volume_name': 'volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae', 'volume_size': 1, 'image_id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f66d6b5d663d40f8431b22fc0d461a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6141694385d4a648a99ab2dec44ede2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16f2dc40e3f449c834b429179dd6fe7f75162ca3b8880adf223bc13931124f2dc3630593a666ac5ce77aafa94ebed86556058f035b77ca66e26347e12e4067ba', 'id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06537cb6-b1c6-48c3-ab37-4a95ed0b937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06537cb6-b1c6-48c3-ab37-4a95ed0b937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:47 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:47 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e27a32-1fab-42c3-95e2-88d424676cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Volume 34ee8ce2-22aa-4a94-8560-a55cca9c3fae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae', 'volume_size': 1, 'image_id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f66d6b5d663d40f8431b22fc0d461a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6141694385d4a648a99ab2dec44ede2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16f2dc40e3f449c834b429179dd6fe7f75162ca3b8880adf223bc13931124f2dc3630593a666ac5ce77aafa94ebed86556058f035b77ca66e26347e12e4067ba', 'id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Trying to clone 34ee8ce2-22aa-4a94-8560-a55cca9c3fae from image bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:03:47 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce6aac-f5ce-45fc-980f-ed1a81582e00]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:47 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.326s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:47 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD Jul 31 11:03:47 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 0 in 0.550s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Deleted volume successfully. Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-dc8b9664-1433-4f1c-ab81-7862de2c7270 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-eb59e2b6-6c85-4126-83d6-0bce14c9c436-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:47 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:47 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:47 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD Jul 31 11:03:48 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 1 in 0.419s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Downloaded image 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 1acbfb9b-1aa9-42a4-95af-fcb9de461929 successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 for user 31a2f187497e444d969114717ff7a8c3 is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Marking volume 1acbfb9b-1aa9-42a4-95af-fcb9de461929 as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Copying metadata from image 054f039c-e113-4ed9-900a-f72893aac763 to 1acbfb9b-1aa9-42a4-95af-fcb9de461929. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Creating volume glance metadata for volume 1acbfb9b-1aa9-42a4-95af-fcb9de461929 backed by image 054f039c-e113-4ed9-900a-f72893aac763 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f381a9-ecff-4812-ab77-dfd1ccbafef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3461ed-d1a6-45f6-b13d-94072b85af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Volume volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 (1acbfb9b-1aa9-42a4-95af-fcb9de461929): created successfully Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3461ed-d1a6-45f6-b13d-94072b85af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (208c9822-f561-401b-abba-b47dc68b27e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f94643ea-29b0-48ab-aa3b-fac0e095f7e9 tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:03:48 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Temporary image bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d is fetched for user 7cb4ea5be4f3420ebb8670e7b2959a2b. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-f8a7545e-dcc9-48af-a5d2-1042602fdfb2-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-f8a7545e-dcc9-48af-a5d2-1042602fdfb2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "cinder-quobyte-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743d8ec-24d3-437f-bd89-1b4a3b5e8cea]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af29420-5e4d-41e2-b47e-5a47dbd07064]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD Jul 31 11:03:48 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 Jul 31 11:03:48 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Flow 'volume_create_manager' (f7221060-54f2-4c90-b2bd-9ecd90887e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dbb63c-a2b8-42f9-b25e-2f9653863534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dbb63c-a2b8-42f9-b25e-2f9653863534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-898903614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592c51ce-e16d-4b85-8901-e15a412df179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4ac5894b4b4f67bf3abbb8ed0f97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:49Z,use_quota=True,user_id='7c8de9bccb594afab081c1ba6ae9ccf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a05cc5-c210-4873-8f7f-a4984d059d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a05cc5-c210-4873-8f7f-a4984d059d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24d57b9-b711-4175-b194-f7a76ef8c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:03:48 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" returned: 0 in 0.395s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:48 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2 Jul 31 11:03:48 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24d57b9-b711-4175-b194-f7a76ef8c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '592c51ce-e16d-4b85-8901-e15a412df179', 'volume_name': 'volume-592c51ce-e16d-4b85-8901-e15a412df179', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f57cd47-ec00-419a-85b2-9a2dd6d917a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f57cd47-ec00-419a-85b2-9a2dd6d917a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962a0c73-1b2e-434a-8d1d-0ce67e540239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:48 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Volume 592c51ce-e16d-4b85-8901-e15a412df179: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-592c51ce-e16d-4b85-8901-e15a412df179', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 31 11:03:48 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Trying to clone 592c51ce-e16d-4b85-8901-e15a412df179 from image 054f039c-e113-4ed9-900a-f72893aac763 at location (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:03:48 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD Jul 31 11:03:48 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" returned: 0 in 0.271s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-quobyte-f8a7545e-dcc9-48af-a5d2-1042602fdfb2" released by "delete_volume" :: held 0.733s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:49 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD" returned: 1 in 0.397s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ee8ce2-22aa-4a94-8560-a55cca9c3fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6141694385d4a648a99ab2dec44ede2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:47Z,use_quota=True,user_id='7cb4ea5be4f3420ebb8670e7b2959a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d56c34c-d7c6-4b18-8638-83b4ec7a7ce7),volume_type_id=0d56c34c-d7c6-4b18-8638-83b4ec7a7ce7)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Creating volume 34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:49 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:49 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae 1073741824 Jul 31 11:03:49 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Created reservations ['cd595305-56a7-4abd-a0ab-c7362931f39d', 'd660a237-2466-4d82-abf3-017818eaabcc', 'c83e7514-0bd2-4801-8ce7-7e3bc65ebf25', '3a5121bb-94ca-4128-9c8c-a0b523bfd79b'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:03:49 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Image download 20.69 MB at 20.69 MB/s Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b69a0c-2705-493c-8261-1e40be092095]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:49 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:49 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD Jul 31 11:03:49 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:49 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Deleted volume successfully. Jul 31 11:03:49 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae 1073741824" returned: 0 in 0.642s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9b83b5e6-f78a-4def-b753-6f30920da344 tempest-VolumeDependencyTests-1784093296 None] Lock "cinder-f8a7545e-dcc9-48af-a5d2-1042602fdfb2-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 is fetched for user 7c8de9bccb594afab081c1ba6ae9ccf2. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:03:50 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:50 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ddcd67-8ac1-42f5-9e73-e80ea19cae60]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD Jul 31 11:03:50 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 0 in 0.339s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Attempting download of bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d ((None, [{'url': 'file:///opt/stack/data/glance/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'metadata': {}}])) to volume 34ee8ce2-22aa-4a94-8560-a55cca9c3fae. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dbce53-8a85-47ca-a060-61d980406a1b]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-898903614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592c51ce-e16d-4b85-8901-e15a412df179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4ac5894b4b4f67bf3abbb8ed0f97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:49Z,use_quota=True,user_id='7c8de9bccb594afab081c1ba6ae9ccf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Creating volume 592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:50 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:50 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h Jul 31 11:03:50 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 1073741824 Jul 31 11:03:50 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (26f29afd-8c9b-4f74-b7df-57c1814a5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de63f176-3b6a-4df4-915c-80bc7b550f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de63f176-3b6a-4df4-915c-80bc7b550f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-172285072',display_name='tempest-VolumesGetTest-Volume-1933244114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a7f8c3-61e9-4413-93ed-5fea79e1f6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:51Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e7839d-e09a-4255-ab51-ab02d94954d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e7839d-e09a-4255-ab51-ab02d94954d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ac2c7e-af65-42ed-aa6d-a0a9fc04b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ac2c7e-af65-42ed-aa6d-a0a9fc04b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a7f8c3-61e9-4413-93ed-5fea79e1f6b3', 'volume_name': 'volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153d9cb6-81bd-40e1-9371-66dfb40b4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153d9cb6-81bd-40e1-9371-66dfb40b4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a9f34f-0139-4c63-b452-5ddd09039cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Volume 37a7f8c3-61e9-4413-93ed-5fea79e1f6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3', 'volume_size': 1} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:50 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h" returned: 0 in 0.442s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h Jul 31 11:03:51 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 1073741824" returned: 0 in 0.522s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:03:51 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h" returned: 1 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_3b5vnp5h' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a346b6e-baaf-4bfa-9836-eb8526ba654c]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD Jul 31 11:03:51 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-172285072',display_name='tempest-VolumesGetTest-Volume-1933244114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a7f8c3-61e9-4413-93ed-5fea79e1f6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a85b4a50c8d246019a5cb7f709ffedb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:51Z,use_quota=True,user_id='31a2f187497e444d969114717ff7a8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Creating volume 37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:51 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 1073741824 Jul 31 11:03:51 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Attempting download of 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 592c51ce-e16d-4b85-8901-e15a412df179. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c71b529-bd2c-4406-8ae5-c624f08205da]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:51 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y Jul 31 11:03:51 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:51 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD Jul 31 11:03:51 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 1073741824" returned: 0 in 0.568s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y" returned: 0 in 0.427s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d was raw, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:52 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 Jul 31 11:03:52 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y Jul 31 11:03:52 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3" returned: 0 in 0.300s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a9f34f-0139-4c63-b452-5ddd09039cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e185c-56f4-4d35-aedd-6b694814f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Volume volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 (37a7f8c3-61e9-4413-93ed-5fea79e1f6b3): created successfully Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e185c-56f4-4d35-aedd-6b694814f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:52 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Flow 'volume_create_manager' (26f29afd-8c9b-4f74-b7df-57c1814a5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y" returned: 1 in 0.419s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_054f039c-e113-4ed9-900a-f72893aac763_mxm60f7y' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55cd45-3a8d-4792-92c7-94240aafc07c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-00ae0936-43b5-4dbd-96cc-02205e7c5282 tempest-VolumesGetTest-1868828259 None] Created volume successfully. Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 0 in 0.420s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d_o3oiyiy8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:52 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae 1G Jul 31 11:03:52 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD Jul 31 11:03:52 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae 1G" returned: 0 in 0.300s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] 054f039c-e113-4ed9-900a-f72893aac763 was qcow2, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[453007ac-b8a0-4cc3-9915-5d6043a66de8]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:52 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:03:52 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:52 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:52 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:53 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 0 in 0.432s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:53 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:53 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Lock "cinder-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc289d2-bbc0-42cd-9474-a134fff02fc4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:53 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 1 in 0.525s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Downloaded image bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d ((None, [{'url': 'file:///opt/stack/data/glance/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'metadata': {}}])) to volume 34ee8ce2-22aa-4a94-8560-a55cca9c3fae successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Temporary image bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d for user 7cb4ea5be4f3420ebb8670e7b2959a2b is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Marking volume 34ee8ce2-22aa-4a94-8560-a55cca9c3fae as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Copying metadata from image bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d to 34ee8ce2-22aa-4a94-8560-a55cca9c3fae. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Creating volume glance metadata for volume 34ee8ce2-22aa-4a94-8560-a55cca9c3fae backed by image bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5f66d6b5d663d40f8431b22fc0d461a0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:03:53 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 Jul 31 11:03:53 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e27a32-1fab-42c3-95e2-88d424676cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae', 'volume_size': 1, 'image_id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5f66d6b5d663d40f8431b22fc0d461a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6141694385d4a648a99ab2dec44ede2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16f2dc40e3f449c834b429179dd6fe7f75162ca3b8880adf223bc13931124f2dc3630593a666ac5ce77aafa94ebed86556058f035b77ca66e26347e12e4067ba', 'id': 'bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfdd7e2f-0b9f-46bd-aeac-9ac24fd6950d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d43cc3e-0f25-429d-a9bb-a1f7a23f3135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Volume volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae (34ee8ce2-22aa-4a94-8560-a55cca9c3fae): created successfully Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d43cc3e-0f25-429d-a9bb-a1f7a23f3135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Flow 'volume_create_manager' (1795c3dd-dfd8-4bd0-b8eb-dd604a356671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bbd39086-5ef6-41e3-8291-62655c406210 tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Created volume successfully. Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Acquiring lock "cinder-34ee8ce2-22aa-4a94-8560-a55cca9c3fae-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "cinder-34ee8ce2-22aa-4a94-8560-a55cca9c3fae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:54 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3" returned: 0 in 0.492s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:54 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3 Jul 31 11:03:54 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Acquiring lock "cinder-quobyte-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "cinder-quobyte-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[511c65e9-fa9f-447a-9ae7-84edbea35fea]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:54 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:54 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:54 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3" returned: 0 in 0.304s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3" released by "delete_volume" :: held 0.846s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:54 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 1.821s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_054f039c-e113-4ed9-900a-f72893aac763__f2o40zydevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:03:54 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Converted 112.00 MB image at 61.35 MB/s Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:54 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 1G Jul 31 11:03:54 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Created reservations ['01b85624-e7a0-4b8a-8ae2-2043bf17014b', 'a5f21f2a-0ca4-4254-9930-2c3f8f72edc9', 'c36fd209-17f8-4675-b7ca-1f487ef0d726', '9d9b6952-0163-4159-9739-135610d84c27'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:54 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:54 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:54 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 0 in 0.487s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-1acbfb9b-1aa9-42a4-95af-fcb9de461929-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Lock "cinder-1acbfb9b-1aa9-42a4-95af-fcb9de461929-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:55 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Acquiring lock "cinder-quobyte-1acbfb9b-1aa9-42a4-95af-fcb9de461929" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 1G" returned: 0 in 0.459s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-1acbfb9b-1aa9-42a4-95af-fcb9de461929" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:03:55 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:55 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aa4821-4567-4e0f-88f8-90fb91d285db]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329a25d-bf67-4b43-be1a-0c0bf8b5a7d1]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.412s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0f8f46c9-b105-4cbf-b253-566c1c5d5408 tempest-VolumesGetTest-1868828259 None] Lock "cinder-37a7f8c3-61e9-4413-93ed-5fea79e1f6b3-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:55 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:03:55 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:55 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 1 in 0.595s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae Jul 31 11:03:55 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 0.437s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 0 in 0.517s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:55 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:03:55 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:55 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:55 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" returned: 0 in 0.324s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "cinder-quobyte-34ee8ce2-22aa-4a94-8560-a55cca9c3fae" released by "delete_volume" :: held 1.485s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:55 devstack cinder-volume[88837]: WARNING cinder.quota [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:55 devstack cinder-volume[88837]: WARNING cinder.quota [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 31 11:03:55 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Created reservations ['b9474978-50c2-4d14-80dc-2371ef713f0e', '888989a7-c5f2-4186-b7c3-19c90c1c0e42', '998c13f9-e95e-4f7d-8abd-faa4071118aa', '689e13d2-1973-4e07-b72c-6cb9926e08f4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:56 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 1 in 0.458s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Downloaded image 054f039c-e113-4ed9-900a-f72893aac763 ((None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}])) to volume 592c51ce-e16d-4b85-8901-e15a412df179 successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Temporary image 054f039c-e113-4ed9-900a-f72893aac763 for user 7c8de9bccb594afab081c1ba6ae9ccf2 is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Marking volume 592c51ce-e16d-4b85-8901-e15a412df179 as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:03:56 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:56 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Copying metadata from image 054f039c-e113-4ed9-900a-f72893aac763 to 592c51ce-e16d-4b85-8901-e15a412df179. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Creating volume glance metadata for volume 592c51ce-e16d-4b85-8901-e15a412df179 backed by image 054f039c-e113-4ed9-900a-f72893aac763 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:03:56 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 1 in 0.424s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:56 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929 Jul 31 11:03:56 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962a0c73-1b2e-434a-8d1d-0ce67e540239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592c51ce-e16d-4b85-8901-e15a412df179', 'volume_size': 1, 'image_id': '054f039c-e113-4ed9-900a-f72893aac763', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/054f039c-e113-4ed9-900a-f72893aac763', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b03b90a77a64f11957204b3d0b13c9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '054f039c-e113-4ed9-900a-f72893aac763', 'created_at': datetime.datetime(2026, 7, 31, 8, 44, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 8, 44, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/054f039c-e113-4ed9-900a-f72893aac763/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325c7b06-3c70-4a65-9188-132476ae688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Volume volume-592c51ce-e16d-4b85-8901-e15a412df179 (592c51ce-e16d-4b85-8901-e15a412df179): created successfully Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325c7b06-3c70-4a65-9188-132476ae688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Flow 'volume_create_manager' (f7221060-54f2-4c90-b2bd-9ecd90887e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-909c4fde-5cfd-4370-a43d-646409e1b93b tempest-TestShelveInstance-171741359 None] Created volume successfully. Jul 31 11:03:56 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Flow 'volume_create_manager' (6cdc984c-a700-46d5-88e2-517bbae7df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389c6eab-f577-48f1-8726-7c8cd03c5369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-1acbfb9b-1aa9-42a4-95af-fcb9de461929" returned: 0 in 0.371s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Deleted volume successfully. Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Lock "cinder-quobyte-1acbfb9b-1aa9-42a4-95af-fcb9de461929" released by "delete_volume" :: held 1.405s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389c6eab-f577-48f1-8726-7c8cd03c5369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6c0449-7be8-4348-bdcd-ad743dc9e75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271dddbd36ba4d138f5848bc6ddc1e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:56Z,use_quota=True,user_id='861144c0755745c180dd466e3de31f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9aeefa2-ab3f-4579-8a68-ffa81709dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9aeefa2-ab3f-4579-8a68-ffa81709dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eff7e98-38d8-4a5a-adf5-ae313be28779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-db824bec-203e-4a97-bbaa-129fcee707ca tempest-VolumeAndVolumeTypeFromImageTest-1461369100 None] Lock "cinder-34ee8ce2-22aa-4a94-8560-a55cca9c3fae-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Created reservations ['8676fcec-fc88-42d7-b74d-48e5aa3aa80f', 'f9776a12-07ad-4ca4-a78c-2161a880a1d3', '1090a9fc-2b5d-44fa-8d69-584b471ecd37', '62876c44-0e15-4452-a5c6-d49a909e0ded'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:56 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:03:56 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eff7e98-38d8-4a5a-adf5-ae313be28779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef6c0449-7be8-4348-bdcd-ad743dc9e75d', 'volume_name': 'volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d', 'volume_size': 1, 'image_id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c79aef84d0a139a3098a74fe20f63d06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271dddbd36ba4d138f5848bc6ddc1e6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60ef53cb0407500defa7120a4e00a5535bde6036c668e06a18162fe2f151b31100477de22aeb0e362966e2a21eeb1b20fae93abc51dfc16c9730dc78e6fb5ee4', 'id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e/file', 'properties': {}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7958572d-d82d-46b6-be79-7b427cad8d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7958572d-d82d-46b6-be79-7b427cad8d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea00b629-8fe9-427a-82b1-8d3a5e1e9bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:03:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Volume ef6c0449-7be8-4348-bdcd-ad743dc9e75d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d', 'volume_size': 1, 'image_id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c79aef84d0a139a3098a74fe20f63d06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271dddbd36ba4d138f5848bc6ddc1e6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60ef53cb0407500defa7120a4e00a5535bde6036c668e06a18162fe2f151b31100477de22aeb0e362966e2a21eeb1b20fae93abc51dfc16c9730dc78e6fb5ee4', 'id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e/file', 'properties': {}}, 'image_service': } Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Trying to clone ef6c0449-7be8-4348-bdcd-ad743dc9e75d from image 357549b3-4b9d-4bfd-a420-fcdee76a4e9e at location (None, [{'url': 'file:///opt/stack/data/glance/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:03:56 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:03:56 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2355684-e1b0-4e26-a2ba-9fd2439c2f26]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:57 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.297s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:03:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Deleted volume successfully. Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0c33944-0998-4788-9234-494d87ec9a1b tempest-VolumesGetTest-1868828259 None] Lock "cinder-1acbfb9b-1aa9-42a4-95af-fcb9de461929-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:03:57 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD Jul 31 11:03:57 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:57 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:57 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD Jul 31 11:03:57 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:57 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD" returned: 1 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Temporary image 357549b3-4b9d-4bfd-a420-fcdee76a4e9e is fetched for user 861144c0755745c180dd466e3de31f84. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd14423b-fc01-41fb-b439-14f0d54dfeed]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:57 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD Jul 31 11:03:57 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:58 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:58 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD Jul 31 11:03:58 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:58 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6c0449-7be8-4348-bdcd-ad743dc9e75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271dddbd36ba4d138f5848bc6ddc1e6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:03:56Z,use_quota=True,user_id='861144c0755745c180dd466e3de31f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Creating volume ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:03:58 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:03:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:58 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d 1073741824 Jul 31 11:03:58 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:59 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d 1073741824" returned: 0 in 0.660s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:03:59 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:03:59 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:03:59 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 0 in 0.379s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Attempting download of 357549b3-4b9d-4bfd-a420-fcdee76a4e9e ((None, [{'url': 'file:///opt/stack/data/glance/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'metadata': {}}])) to volume ef6c0449-7be8-4348-bdcd-ad743dc9e75d. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8354f52-262f-4db5-8a26-883ec9779d58]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:03:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:00 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1 Jul 31 11:04:00 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:00 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:00 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1 Jul 31 11:04:00 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:00 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1" returned: 1 in 0.451s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_kcfedmt1' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9892a0c9-9467-4acd-b5e6-f6821f47963e]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:00 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD Jul 31 11:04:00 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:01 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:01 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD Jul 31 11:04:01 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d880e-794e-4f1c-9d4c-932f39232fe4]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:01 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD" returned: 1 in 0.583s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] 357549b3-4b9d-4bfd-a420-fcdee76a4e9e was raw, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:04:01 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:04:01 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:01 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:04:01 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:02 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 0.452s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:02 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:04:02 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:02 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 0 in 0.638s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_357549b3-4b9d-4bfd-a420-fcdee76a4e9e_cfx9pea1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:04:02 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:02 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d 1G Jul 31 11:04:02 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:02 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 1 in 0.638s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.169s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-592c51ce-e16d-4b85-8901-e15a412df179', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cce2b0d-ad00-497a-a008-1901fe43acc3', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:04:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-a9af2c33-3618-4fb0-a298-31155cfe7563 req-41f917bc-d39f-4b60-8ab8-56f39e15179e tempest-TestShelveInstance-171741359 None] attachment_update completed successfully. Jul 31 11:04:03 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d 1G" returned: 0 in 0.572s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f551d-42b9-488d-8839-e1d2bd9ee224]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (332dd614-67e8-4981-81e8-ca463e92a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4281976-860d-4a91-aaeb-bf47d74011e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4281976-860d-4a91-aaeb-bf47d74011e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883326728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98c4965-acfb-4e8b-8420-d6c1e7834fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:03Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fe217c-6caf-4a9e-864b-7daa233ddf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fe217c-6caf-4a9e-864b-7daa233ddf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857f1f12-15e2-4c95-89e5-12a157648f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857f1f12-15e2-4c95-89e5-12a157648f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98c4965-acfb-4e8b-8420-d6c1e7834fbf', 'volume_name': 'volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f359cb73-5a8b-46ad-9909-434eadbd20a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f359cb73-5a8b-46ad-9909-434eadbd20a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08843f5d-8db9-42b9-99a2-7acda93fee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Volume f98c4965-acfb-4e8b-8420-d6c1e7834fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf', 'volume_size': 1} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1883326728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98c4965-acfb-4e8b-8420-d6c1e7834fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:03Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Creating volume f98c4965-acfb-4e8b-8420-d6c1e7834fbf {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:03 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:04:03 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:03 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:03 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf 1073741824 Jul 31 11:04:03 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:03 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 0 in 0.625s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:03 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:04:03 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (fdc4df09-b4ab-476c-8f47-9185b3320582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5b9ff-7836-442d-8816-5b65fef90f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5b9ff-7836-442d-8816-5b65fef90f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821565606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1e991c-28a9-4842-bcc9-87f4ae10793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:04Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5b979-9e78-43fb-a164-6adc71ee0c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5b979-9e78-43fb-a164-6adc71ee0c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aade2bfc-d555-4e5e-834d-a41f8b0d81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aade2bfc-d555-4e5e-834d-a41f8b0d81a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1e991c-28a9-4842-bcc9-87f4ae10793c', 'volume_name': 'volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e172370-d1fa-4556-9076-a3dab0325b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e172370-d1fa-4556-9076-a3dab0325b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb4045-51dc-480f-81b6-22a498ae2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Volume 8d1e991c-28a9-4842-bcc9-87f4ae10793c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c', 'volume_size': 1} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:04 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf 1073741824" returned: 0 in 0.854s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:04 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 1 in 0.619s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Downloaded image 357549b3-4b9d-4bfd-a420-fcdee76a4e9e ((None, [{'url': 'file:///opt/stack/data/glance/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'metadata': {}}])) to volume ef6c0449-7be8-4348-bdcd-ad743dc9e75d successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Temporary image 357549b3-4b9d-4bfd-a420-fcdee76a4e9e for user 861144c0755745c180dd466e3de31f84 is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Marking volume ef6c0449-7be8-4348-bdcd-ad743dc9e75d as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:04:04 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf Jul 31 11:04:04 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Copying metadata from image 357549b3-4b9d-4bfd-a420-fcdee76a4e9e to ef6c0449-7be8-4348-bdcd-ad743dc9e75d. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Creating volume glance metadata for volume ef6c0449-7be8-4348-bdcd-ad743dc9e75d backed by image 357549b3-4b9d-4bfd-a420-fcdee76a4e9e with: {'image_id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c79aef84d0a139a3098a74fe20f63d06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea00b629-8fe9-427a-82b1-8d3a5e1e9bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d', 'volume_size': 1, 'image_id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c79aef84d0a139a3098a74fe20f63d06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271dddbd36ba4d138f5848bc6ddc1e6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60ef53cb0407500defa7120a4e00a5535bde6036c668e06a18162fe2f151b31100477de22aeb0e362966e2a21eeb1b20fae93abc51dfc16c9730dc78e6fb5ee4', 'id': '357549b3-4b9d-4bfd-a420-fcdee76a4e9e', 'created_at': datetime.datetime(2026, 7, 31, 9, 3, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 3, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/357549b3-4b9d-4bfd-a420-fcdee76a4e9e/file', 'properties': {}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708d443b-f47c-4078-bc98-c825293f08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:04 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Volume volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d (ef6c0449-7be8-4348-bdcd-ad743dc9e75d): created successfully Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708d443b-f47c-4078-bc98-c825293f08cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Flow 'volume_create_manager' (6cdc984c-a700-46d5-88e2-517bbae7df7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ad87675b-b355-48ca-a8c8-3155aaf72501 tempest-VolumeImageDependencyTests-950204537 None] Created volume successfully. Jul 31 11:04:04 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf" returned: 0 in 0.490s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821565606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1e991c-28a9-4842-bcc9-87f4ae10793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:04Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Creating volume 8d1e991c-28a9-4842-bcc9-87f4ae10793c {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:04 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:04 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c 1073741824 Jul 31 11:04:04 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08843f5d-8db9-42b9-99a2-7acda93fee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48036be-1c26-4392-b855-8f25d0931526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Volume volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf (f98c4965-acfb-4e8b-8420-d6c1e7834fbf): created successfully Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48036be-1c26-4392-b855-8f25d0931526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (332dd614-67e8-4981-81e8-ca463e92a773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (ec2d3a93-f91f-4dc0-8e11-ba1c377ef29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4789f49-5942-4b9b-b18e-25ee403925d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4789f49-5942-4b9b-b18e-25ee403925d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687898964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c342eb7b-e255-4ddd-83a1-bdd116eb4328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:05Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71eed8cb-bf53-450f-a333-14a14099e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71eed8cb-bf53-450f-a333-14a14099e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13322dbf-d369-486a-828b-5919fa4c1e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13322dbf-d369-486a-828b-5919fa4c1e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c342eb7b-e255-4ddd-83a1-bdd116eb4328', 'volume_name': 'volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ec8ea1-ede0-43c6-8edf-1609b4c0f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ec8ea1-ede0-43c6-8edf-1609b4c0f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56446213-279b-4de3-a9da-4379fe26a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Volume c342eb7b-e255-4ddd-83a1-bdd116eb4328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328', 'volume_size': 1} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f3f07999-6341-43b9-a7c1-b33bf3fb81c8 tempest-CreateVolumesFromImageTest-966856451 None] Created volume successfully. Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (72a8b5b0-5df9-4fd7-ae7d-6706e9874db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3f3879-c701-437b-ad86-bae051eade76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3f3879-c701-437b-ad86-bae051eade76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-257881699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18345d7a-40bd-4258-adbd-4af60dcebfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:05Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd2079c-85c0-4b73-aec2-500c42036b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd2079c-85c0-4b73-aec2-500c42036b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f04ee-bf77-4920-ad5d-34831ceb8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f04ee-bf77-4920-ad5d-34831ceb8785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18345d7a-40bd-4258-adbd-4af60dcebfc2', 'volume_name': 'volume-18345d7a-40bd-4258-adbd-4af60dcebfc2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4d3b12-581a-4ff4-a357-8ceebad440de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e4d3b12-581a-4ff4-a357-8ceebad440de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:05 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820bedfb-ebe2-4e96-8cfc-07014fc2783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:05 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Volume 18345d7a-40bd-4258-adbd-4af60dcebfc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18345d7a-40bd-4258-adbd-4af60dcebfc2', 'volume_size': 1} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c 1073741824" returned: 0 in 0.827s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Acquiring lock "cinder-ef6c0449-7be8-4348-bdcd-ad743dc9e75d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Lock "cinder-ef6c0449-7be8-4348-bdcd-ad743dc9e75d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:05 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c Jul 31 11:04:05 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Acquiring lock "cinder-quobyte-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Lock "cinder-quobyte-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb6964-121f-44ca-b3c7-b010fa1cef5f]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (d8ee40c4-6713-4e06-b0e2-31ad1dca93bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033e9976-11ff-4ae1-be22-f1a2b09d2a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:06 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033e9976-11ff-4ae1-be22-f1a2b09d2a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-973068829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c263b38-c44a-4480-b266-ef18f6b1110d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:06Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ad8c20-71b9-4178-a746-277672edea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ad8c20-71b9-4178-a746-277672edea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cfacb0-60cd-4a95-8095-ac07bc76c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cfacb0-60cd-4a95-8095-ac07bc76c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c263b38-c44a-4480-b266-ef18f6b1110d', 'volume_name': 'volume-7c263b38-c44a-4480-b266-ef18f6b1110d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fc78a0-68b5-44a6-a9e0-9199c0264c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fc78a0-68b5-44a6-a9e0-9199c0264c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8aecb2-2612-40a4-bdba-17c5587fbfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:06 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Volume 7c263b38-c44a-4480-b266-ef18f6b1110d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c263b38-c44a-4480-b266-ef18f6b1110d', 'volume_size': 1} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687898964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c342eb7b-e255-4ddd-83a1-bdd116eb4328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:05Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Creating volume c342eb7b-e255-4ddd-83a1-bdd116eb4328 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:06 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:06 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:04:06 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bb4045-51dc-480f-81b6-22a498ae2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983dfa0e-7807-427b-9c0d-017b61a0c933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:06 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 1073741824 Jul 31 11:04:06 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:06 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Volume volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c (8d1e991c-28a9-4842-bcc9-87f4ae10793c): created successfully Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983dfa0e-7807-427b-9c0d-017b61a0c933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (fdc4df09-b4ab-476c-8f47-9185b3320582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-639f5c1a-7a10-46b6-a1aa-6a3f63faa864 tempest-CreateVolumesFromImageTest-966856451 None] Created volume successfully. Jul 31 11:04:06 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 0 in 0.888s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:07 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:04:07 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:07 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 1073741824" returned: 0 in 1.195s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:07 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 Jul 31 11:04:07 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:07 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 1 in 0.698s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:07 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d Jul 31 11:04:07 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:07 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-257881699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18345d7a-40bd-4258-adbd-4af60dcebfc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:05Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Creating volume 18345d7a-40bd-4258-adbd-4af60dcebfc2 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:07 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56446213-279b-4de3-a9da-4379fe26a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88078c2-f086-412f-aa8f-bfe2f4e4f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:08 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 1073741824 Jul 31 11:04:08 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Volume volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 (c342eb7b-e255-4ddd-83a1-bdd116eb4328): created successfully Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88078c2-f086-412f-aa8f-bfe2f4e4f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (ec2d3a93-f91f-4dc0-8e11-ba1c377ef29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2fb9a5c6-f86b-4aa9-8f68-1269de4960ea tempest-CreateVolumesFromImageTest-966856451 None] Created volume successfully. Jul 31 11:04:08 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" returned: 0 in 0.601s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Lock "cinder-quobyte-ef6c0449-7be8-4348-bdcd-ad743dc9e75d" released by "delete_volume" :: held 2.289s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Created reservations ['98e6ddaa-f62f-44f8-b28a-3a5b694c50c1', 'f77f3a6c-9463-4432-8fd3-3f0503778161', '81f98a4f-bf32-483a-be94-06ec5d5e736c', '554c7492-1f82-4eef-8c00-01398a01cbab'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:08 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:08 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:08 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 1073741824" returned: 0 in 0.694s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:08 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 Jul 31 11:04:08 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:08 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.333s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Deleted volume successfully. Jul 31 11:04:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b08ccfe-511e-4ed7-933c-41d6c0afd9ce tempest-VolumeImageDependencyTests-950204537 None] Lock "cinder-ef6c0449-7be8-4348-bdcd-ad743dc9e75d-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:09 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2" returned: 0 in 0.320s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-973068829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c263b38-c44a-4480-b266-ef18f6b1110d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80319a36910348609fa7ca27e3c75b89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:06Z,use_quota=True,user_id='e97c48ef2862406a9c64deb7a83d9857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Creating volume 7c263b38-c44a-4480-b266-ef18f6b1110d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:09 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820bedfb-ebe2-4e96-8cfc-07014fc2783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18345d7a-40bd-4258-adbd-4af60dcebfc2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939904a3-78ba-4e79-9828-54cc3a4022b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:09 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d 1073741824 Jul 31 11:04:09 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Volume volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 (18345d7a-40bd-4258-adbd-4af60dcebfc2): created successfully Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939904a3-78ba-4e79-9828-54cc3a4022b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (72a8b5b0-5df9-4fd7-ae7d-6706e9874db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0b69e843-51f4-4ab8-b12a-0317fd81eb11 tempest-CreateVolumesFromImageTest-966856451 None] Created volume successfully. Jul 31 11:04:09 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d 1073741824" returned: 0 in 0.612s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:09 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d Jul 31 11:04:09 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:10 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d" returned: 0 in 0.601s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8aecb2-2612-40a4-bdba-17c5587fbfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c263b38-c44a-4480-b266-ef18f6b1110d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eef7435-5350-418f-abd8-95ac2bd056e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:10 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Volume volume-7c263b38-c44a-4480-b266-ef18f6b1110d (7c263b38-c44a-4480-b266-ef18f6b1110d): created successfully Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eef7435-5350-418f-abd8-95ac2bd056e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Flow 'volume_create_manager' (d8ee40c4-6713-4e06-b0e2-31ad1dca93bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9e95043c-1b42-459d-90bd-7060c7a54442 tempest-CreateVolumesFromImageTest-966856451 None] Created volume successfully. Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-7c263b38-c44a-4480-b266-ef18f6b1110d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-7c263b38-c44a-4480-b266-ef18f6b1110d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-quobyte-7c263b38-c44a-4480-b266-ef18f6b1110d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-7c263b38-c44a-4480-b266-ef18f6b1110d" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9548d89b-808f-4c7b-a6ea-4258bb5688ee]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:11 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d Jul 31 11:04:11 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:11 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d" returned: 0 in 0.601s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:11 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d Jul 31 11:04:11 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:12 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c263b38-c44a-4480-b266-ef18f6b1110d" returned: 0 in 0.394s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-7c263b38-c44a-4480-b266-ef18f6b1110d" released by "delete_volume" :: held 1.066s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Created reservations ['995751e9-1973-487d-af6c-5ffbf5ea71f7', '26828af5-1850-4ee4-a660-0e5c9b455899', '40769078-7944-476a-9440-26e5b9e96eff', '807c4c26-f84b-4b4b-8e5a-7e71f2310010'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:12 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:12 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:12 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.517s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:12 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Deleted volume successfully. Jul 31 11:04:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119e6746-da39-4739-8945-9afd0621fa3c tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-7c263b38-c44a-4480-b266-ef18f6b1110d-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-18345d7a-40bd-4258-adbd-4af60dcebfc2-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-18345d7a-40bd-4258-adbd-4af60dcebfc2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-quobyte-18345d7a-40bd-4258-adbd-4af60dcebfc2" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-18345d7a-40bd-4258-adbd-4af60dcebfc2" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:13 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5603f478-84a1-4528-897c-c17f6f93346a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:13 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 Jul 31 11:04:13 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:14 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2" returned: 0 in 0.895s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:14 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2 Jul 31 11:04:14 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:14 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-18345d7a-40bd-4258-adbd-4af60dcebfc2" returned: 0 in 0.411s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-18345d7a-40bd-4258-adbd-4af60dcebfc2" released by "delete_volume" :: held 1.405s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Created reservations ['d88b7b09-a452-4a8d-b496-52428e37ffa9', 'ecc5bd15-9a47-40d7-8b19-8128f627787c', 'c06cc8bc-b461-4fcd-a7db-e442220eb1a4', 'e2835791-ce33-4f77-afb7-306543d495c0'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:15 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:15 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:15 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.410s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:15 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Deleted volume successfully. Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a5a3623d-cf1a-4542-aa45-ffb7f4b53431 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-18345d7a-40bd-4258-adbd-4af60dcebfc2-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-c342eb7b-e255-4ddd-83a1-bdd116eb4328-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-c342eb7b-e255-4ddd-83a1-bdd116eb4328-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-quobyte-c342eb7b-e255-4ddd-83a1-bdd116eb4328" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-c342eb7b-e255-4ddd-83a1-bdd116eb4328" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb96efd-5c0c-43cd-a5bb-c51265776c53]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:16 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 Jul 31 11:04:16 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328" returned: 0 in 0.837s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:16 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:17 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328 Jul 31 11:04:17 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:17 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c342eb7b-e255-4ddd-83a1-bdd116eb4328" returned: 0 in 0.768s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-c342eb7b-e255-4ddd-83a1-bdd116eb4328" released by "delete_volume" :: held 1.701s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Created reservations ['75b9819f-eb9b-4a03-8733-cda46bc44bcb', 'b10b2609-429e-4c85-b787-f822b7af4602', '72de3f33-e60d-4ac4-80ed-3ed4d2b30537', '831a94bf-31d0-4f0d-8429-23359728fd03'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:17 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:17 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:18 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Deleted volume successfully. Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4aadc3f-2a89-4a62-98f9-491bcb3bb302 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-c342eb7b-e255-4ddd-83a1-bdd116eb4328-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-8d1e991c-28a9-4842-bcc9-87f4ae10793c-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-8d1e991c-28a9-4842-bcc9-87f4ae10793c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-quobyte-8d1e991c-28a9-4842-bcc9-87f4ae10793c" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-8d1e991c-28a9-4842-bcc9-87f4ae10793c" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb336ee-ab23-4f07-ae90-6483135d4da5]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:18 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c Jul 31 11:04:18 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Flow 'volume_create_manager' (87fa49e3-9fdf-4ba5-afc2-0e6ecb070341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df7412a-ac52-4f12-bd09-670f5e85e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df7412a-ac52-4f12-bd09-670f5e85e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847983780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0599908-299a-4398-81c8-eca327a3102d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d01436088f4d3680825ac7b6e57e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:19Z,use_quota=True,user_id='52b40af039ce4a6fb9ab4d86abf3c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:19 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762e5361-eb24-42aa-805c-75cce277a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762e5361-eb24-42aa-805c-75cce277a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca11397-91d1-4d80-957c-289d501c8148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca11397-91d1-4d80-957c-289d501c8148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0599908-299a-4398-81c8-eca327a3102d', 'volume_name': 'volume-b0599908-299a-4398-81c8-eca327a3102d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a18204-031f-44ef-806c-501fe8c59fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a18204-031f-44ef-806c-501fe8c59fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60d9b27-75c9-48aa-b4e3-7d99bcf2dfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:19 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Volume b0599908-299a-4398-81c8-eca327a3102d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0599908-299a-4398-81c8-eca327a3102d', 'volume_size': 1} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847983780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0599908-299a-4398-81c8-eca327a3102d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d01436088f4d3680825ac7b6e57e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:19Z,use_quota=True,user_id='52b40af039ce4a6fb9ab4d86abf3c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Creating volume b0599908-299a-4398-81c8-eca327a3102d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:19 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c" returned: 0 in 0.843s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:19 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d 1073741824 Jul 31 11:04:19 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:19 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c Jul 31 11:04:19 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:20 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d 1073741824" returned: 0 in 0.751s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:20 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d1e991c-28a9-4842-bcc9-87f4ae10793c" returned: 0 in 0.782s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-8d1e991c-28a9-4842-bcc9-87f4ae10793c" released by "delete_volume" :: held 1.705s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:20 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d Jul 31 11:04:20 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Created reservations ['46e4324a-caca-4836-b8b1-a37754f8f2aa', 'e7fdabff-e083-4787-9585-33f7e195b630', '6897dbd9-8c4f-49ee-8752-56becd86f555', '192df5b5-d9e5-4f7b-8bd1-63b94174f63f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:20 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:20 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:20 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d" returned: 0 in 0.534s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60d9b27-75c9-48aa-b4e3-7d99bcf2dfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0599908-299a-4398-81c8-eca327a3102d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93be5ae0-95df-4a03-84fd-a8db05f84a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:20 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Volume volume-b0599908-299a-4398-81c8-eca327a3102d (b0599908-299a-4398-81c8-eca327a3102d): created successfully Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93be5ae0-95df-4a03-84fd-a8db05f84a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Flow 'volume_create_manager' (87fa49e3-9fdf-4ba5-afc2-0e6ecb070341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-f98c4965-acfb-4e8b-8420-d6c1e7834fbf-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:20 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9587b258-c0ff-4fbc-a7bd-ec9d1513c5ea tempest-ProjectReaderTests-1410549112 None] Created volume successfully. Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-f98c4965-acfb-4e8b-8420-d6c1e7834fbf-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "cinder-quobyte-f98c4965-acfb-4e8b-8420-d6c1e7834fbf" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-f98c4965-acfb-4e8b-8420-d6c1e7834fbf" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:20 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.629s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Deleted volume successfully. Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c42510-c4e1-452e-8935-9d004b9fba22]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f5b38dd4-69f5-4e09-b132-5679cb370cdf tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-8d1e991c-28a9-4842-bcc9-87f4ae10793c-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:21 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf Jul 31 11:04:21 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (5e694061-c4c7-42e3-9ba2-46196771f810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fd22b9-6e55-4d33-8724-18241234eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fd22b9-6e55-4d33-8724-18241234eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-431363841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f852cc5b-3352-43c8-b5d6-2365176e338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:21Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511247e8-078c-4b64-9c6f-8108da685fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511247e8-078c-4b64-9c6f-8108da685fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c648fc-f8c8-45f9-b8ad-716494405d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c648fc-f8c8-45f9-b8ad-716494405d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f852cc5b-3352-43c8-b5d6-2365176e338b', 'volume_name': 'volume-f852cc5b-3352-43c8-b5d6-2365176e338b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e39a323-68a3-41a8-a674-2a110937fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e39a323-68a3-41a8-a674-2a110937fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a6b4e-c40c-4ef5-935e-e5b2714d5ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:21 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Volume f852cc5b-3352-43c8-b5d6-2365176e338b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f852cc5b-3352-43c8-b5d6-2365176e338b', 'volume_size': 1} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-431363841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f852cc5b-3352-43c8-b5d6-2365176e338b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:21Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Creating volume f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:21 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:21 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b 1073741824 Jul 31 11:04:21 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Acquiring lock "cinder-b0599908-299a-4398-81c8-eca327a3102d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Lock "cinder-b0599908-299a-4398-81c8-eca327a3102d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Acquiring lock "cinder-quobyte-b0599908-299a-4398-81c8-eca327a3102d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Lock "cinder-quobyte-b0599908-299a-4398-81c8-eca327a3102d" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[50709237-84dd-4972-8131-20a71e8aacf9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:21 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf" returned: 0 in 0.896s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:21 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf Jul 31 11:04:21 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d Jul 31 11:04:22 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f98c4965-acfb-4e8b-8420-d6c1e7834fbf" returned: 0 in 0.338s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-quobyte-f98c4965-acfb-4e8b-8420-d6c1e7834fbf" released by "delete_volume" :: held 1.308s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:22 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b 1073741824" returned: 0 in 0.715s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Created reservations ['1e3827c4-7a44-4115-9617-ad19ae650343', '4c07275b-3196-4462-a16e-0938e6e2ea1e', '6a367688-801a-491f-9027-be5c6d6df254', '45cd4041-153a-4c12-b8ca-cbc72a475aae'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:22 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b Jul 31 11:04:22 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:22 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d" returned: 0 in 0.646s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:22 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:22 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d Jul 31 11:04:22 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:22 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b" returned: 0 in 0.295s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a6b4e-c40c-4ef5-935e-e5b2714d5ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f852cc5b-3352-43c8-b5d6-2365176e338b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6911ea45-4c47-4c8f-8ec9-130f7e49c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:22 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Volume volume-f852cc5b-3352-43c8-b5d6-2365176e338b (f852cc5b-3352-43c8-b5d6-2365176e338b): created successfully Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6911ea45-4c47-4c8f-8ec9-130f7e49c56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (5e694061-c4c7-42e3-9ba2-46196771f810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-386af054-8246-44e6-902a-20a66c6cccae tempest-VolumesSnapshotTestJSON-1813106956 None] Created volume successfully. Jul 31 11:04:22 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0599908-299a-4398-81c8-eca327a3102d" returned: 0 in 0.312s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Lock "cinder-quobyte-b0599908-299a-4398-81c8-eca327a3102d" released by "delete_volume" :: held 1.015s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:22 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.373s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Deleted volume successfully. Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9f700b7f-551c-4a10-866e-fb5e5a04d568 tempest-CreateVolumesFromImageTest-966856451 None] Lock "cinder-f98c4965-acfb-4e8b-8420-d6c1e7834fbf-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:22 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Created reservations ['2d480706-f261-48ce-85d4-307232da57f2', '91c5e493-6682-482b-985a-4f066569ca64', '247638b2-047e-4f19-a883-e720acbd4633', '70ec2b3c-3614-4956-ab70-b64c10d013ae'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:23 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:23 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:23 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.253s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Deleted volume successfully. Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-119d117a-eca5-4a57-aa2c-059dc636ff14 tempest-ProjectReaderTests-1410549112 None] Lock "cinder-b0599908-299a-4398-81c8-eca327a3102d-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating offline snapshot a51f4336-8889-47d7-b196-8ab43a3b1763 of volume f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16a623-317c-4a7c-b143-072dd22aa4e2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:24 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b Jul 31 11:04:24 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:24 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b" returned: 0 in 0.510s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:24 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 1G Jul 31 11:04:24 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Flow 'volume_create_manager' (105aca5c-b783-4843-8826-8665817d346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd24c6-2943-468b-9920-05ecc22b4f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd24c6-2943-468b-9920-05ecc22b4f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36401962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681f2c1c-d2d7-419b-8fcc-5b8b2464491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d01436088f4d3680825ac7b6e57e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:25Z,use_quota=True,user_id='52b40af039ce4a6fb9ab4d86abf3c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5946d87c-1ac8-449a-8387-efda5ff94595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5946d87c-1ac8-449a-8387-efda5ff94595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99dc9b3-5be0-4581-ad49-02255587798b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99dc9b3-5be0-4581-ad49-02255587798b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681f2c1c-d2d7-419b-8fcc-5b8b2464491e', 'volume_name': 'volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12ed581-d9bf-4802-9b29-0a054c0b54b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12ed581-d9bf-4802-9b29-0a054c0b54b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b37c6b-587f-47b7-ad0e-7edd2c8d83f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:24 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Volume 681f2c1c-d2d7-419b-8fcc-5b8b2464491e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e', 'volume_size': 1} Jul 31 11:04:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:25 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 1G" returned: 0 in 0.647s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f852cc5b-3352-43c8-b5d6-2365176e338b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:25 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f852cc5b-3352-43c8-b5d6-2365176e338b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 Jul 31 11:04:25 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:25 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f852cc5b-3352-43c8-b5d6-2365176e338b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763" returned: 0 in 0.334s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:25 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 is being set with open permissions: ugo+rw Jul 31 11:04:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:25 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 Jul 31 11:04:25 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:25 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763" returned: 0 in 0.266s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:25 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info Jul 31 11:04:25 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:25 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info" returned: 0 in 0.284s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:26 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info is being set with open permissions: ugo+rw Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:26 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info Jul 31 11:04:26 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:26 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.info" returned: 0 in 0.267s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.406s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36401962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681f2c1c-d2d7-419b-8fcc-5b8b2464491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64d01436088f4d3680825ac7b6e57e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:25Z,use_quota=True,user_id='52b40af039ce4a6fb9ab4d86abf3c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Creating volume 681f2c1c-d2d7-419b-8fcc-5b8b2464491e {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:26 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:26 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e 1073741824 Jul 31 11:04:26 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-466ee562-eed5-4dd0-9ae9-05ef998f6ff7 tempest-VolumesSnapshotTestJSON-1813106956 None] Create snapshot completed successfully Jul 31 11:04:26 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e 1073741824" returned: 0 in 0.678s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:27 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e Jul 31 11:04:27 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-a51f4336-8889-47d7-b196-8ab43a3b1763-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-a51f4336-8889-47d7-b196-8ab43a3b1763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-f852cc5b-3352-43c8-b5d6-2365176e338b" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-f852cc5b-3352-43c8-b5d6-2365176e338b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-a51f4336-8889-47d7-b196-8ab43a3b1763" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-a51f4336-8889-47d7-b196-8ab43a3b1763" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleting offline snapshot a51f4336-8889-47d7-b196-8ab43a3b1763 of volume f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:04:27 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] snapshot_file for this snap is: volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e" returned: 0 in 0.456s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b10b68-7768-4842-9812-36703d566da0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b37c6b-587f-47b7-ad0e-7edd2c8d83f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854f3801-05fd-467e-bb7f-9c732fa273ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:27 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Volume volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e (681f2c1c-d2d7-419b-8fcc-5b8b2464491e): created successfully Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854f3801-05fd-467e-bb7f-9c732fa273ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Flow 'volume_create_manager' (105aca5c-b783-4843-8826-8665817d346e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2ccaae98-29f1-41dc-9005-79158a9e2087 tempest-ProjectReaderTests-1410549112 None] Created volume successfully. Jul 31 11:04:27 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 Jul 31 11:04:27 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Acquiring lock "cinder-681f2c1c-d2d7-419b-8fcc-5b8b2464491e-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Lock "cinder-681f2c1c-d2d7-419b-8fcc-5b8b2464491e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:28 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763" returned: 0 in 0.509s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f852cc5b-3352-43c8-b5d6-2365176e338b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[741962e7-f797-40b1-9ff2-696a2cc8b3b6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Acquiring lock "cinder-quobyte-681f2c1c-d2d7-419b-8fcc-5b8b2464491e" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Lock "cinder-quobyte-681f2c1c-d2d7-419b-8fcc-5b8b2464491e" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eae10f-1086-415c-a93a-efab48a982b6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:28 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b Jul 31 11:04:28 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:28 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e Jul 31 11:04:28 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:28 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b" returned: 0 in 0.393s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:28 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 Jul 31 11:04:28 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:28 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e" returned: 0 in 0.426s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:28 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e Jul 31 11:04:28 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:28 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-681f2c1c-d2d7-419b-8fcc-5b8b2464491e" returned: 0 in 0.262s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Lock "cinder-quobyte-681f2c1c-d2d7-419b-8fcc-5b8b2464491e" released by "delete_volume" :: held 0.732s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:28 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763" returned: 0 in 0.406s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:28 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763 Jul 31 11:04:28 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:28 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Created reservations ['39f9f0df-5cdc-4dcb-a304-85fa2376d0d6', '06f4c750-6b1c-4f68-a62f-63ad84ec1fc6', '08b087ba-39b2-4d09-8b65-9dd171be7853', '66f78daf-c278-490e-88ba-6badbadefd42'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:29 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:29 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:29 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b.a51f4336-8889-47d7-b196-8ab43a3b1763" returned: 0 in 0.307s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-a51f4336-8889-47d7-b196-8ab43a3b1763" released by "_delete_snapshot" :: held 1.782s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-f852cc5b-3352-43c8-b5d6-2365176e338b" released by "delete_snapshot" :: held 1.815s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:29 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.299s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Deleted volume successfully. Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1fab7e34-8cb9-4191-806f-bcb76feacfdb tempest-ProjectReaderTests-1410549112 None] Lock "cinder-681f2c1c-d2d7-419b-8fcc-5b8b2464491e-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['b4d81e19-f506-4a8b-877b-c07a747728dc', '6666028d-8d40-4ea0-8ebf-ae29112ab5e7', 'c0d8c495-4331-4891-8d54-44ab1fe02114', 'a844c9f1-9e79-46ac-9bbb-54e33a65cb6e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Delete snapshot completed successfully. Jul 31 11:04:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e4caf5f0-8f55-4c67-8b99-ed27dfcbfca2 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-a51f4336-8889-47d7-b196-8ab43a3b1763-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (be6bfaf6-7b5b-405d-a8d5-26fc248c02da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21917fbb-6294-4e8b-b319-18cf7936ad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21917fbb-6294-4e8b-b319-18cf7936ad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1081481881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0e9f74-ce00-436c-b160-9c03dba096b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:31Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa837d25-8522-4536-991c-24e6194da2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa837d25-8522-4536-991c-24e6194da2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd265113-a1d2-47d0-a8a4-1cfa355e3a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd265113-a1d2-47d0-a8a4-1cfa355e3a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0e9f74-ce00-436c-b160-9c03dba096b4', 'volume_name': 'volume-3a0e9f74-ce00-436c-b160-9c03dba096b4', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f8c852-3b45-4f8d-8228-695a086c0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f8c852-3b45-4f8d-8228-695a086c0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aebf38-a360-40d4-b999-3be97181827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:31 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume 3a0e9f74-ce00-436c-b160-9c03dba096b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0e9f74-ce00-436c-b160-9c03dba096b4', 'volume_size': 1} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1081481881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0e9f74-ce00-436c-b160-9c03dba096b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:31Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating volume 3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:31 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:31 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 1073741824 Jul 31 11:04:31 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:31 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 1073741824" returned: 0 in 0.455s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:31 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:31 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:32 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aebf38-a360-40d4-b999-3be97181827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0e9f74-ce00-436c-b160-9c03dba096b4', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4917188a-11e6-4fac-8009-54c842a30faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:32 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 (3a0e9f74-ce00-436c-b160-9c03dba096b4): created successfully Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4917188a-11e6-4fac-8009-54c842a30faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (be6bfaf6-7b5b-405d-a8d5-26fc248c02da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-840d20d0-d1c1-400e-918a-8fad70c2bf34 tempest-VolumesSnapshotTestJSON-1813106956 None] Created volume successfully. Jul 31 11:04:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating offline snapshot 7a6be18e-7a93-45de-8280-42a283b345d4 of volume 3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:04:33 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b329d3-6447-4305-af59-d1f6174d7a94]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:33 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:33 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:34 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.458s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:34 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 1G Jul 31 11:04:34 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:34 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 1G" returned: 0 in 0.521s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:34 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 Jul 31 11:04:34 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:34 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4" returned: 0 in 0.341s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:34 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 is being set with open permissions: ugo+rw Jul 31 11:04:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:34 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 Jul 31 11:04:34 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:35 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:35 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info Jul 31 11:04:35 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:35 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info" returned: 0 in 0.385s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:35 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info is being set with open permissions: ugo+rw Jul 31 11:04:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:35 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info Jul 31 11:04:35 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:35 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.info" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c216d949-b10a-4d66-bdd9-e57483e96773 tempest-VolumesSnapshotTestJSON-1813106956 None] Create snapshot completed successfully Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (379d3bac-e87e-4f07-959d-feb880a35694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968a043c-6d68-43e6-8142-d437990a46bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968a043c-6d68-43e6-8142-d437990a46bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1918862881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47fda811-792b-4670-b651-147df461711a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7a6be18e-7a93-45de-8280-42a283b345d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:37Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5818713a-8586-4fde-8ccd-1e64804af1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5818713a-8586-4fde-8ccd-1e64804af1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe0a316-610f-43ba-8f98-d6dd919197c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe0a316-610f-43ba-8f98-d6dd919197c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47fda811-792b-4670-b651-147df461711a', 'volume_name': 'volume-47fda811-792b-4670-b651-147df461711a', 'volume_size': 2, 'snapshot_id': '7a6be18e-7a93-45de-8280-42a283b345d4'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721504ee-91fe-4e88-af00-b0042071184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721504ee-91fe-4e88-af00-b0042071184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5e828c-b25b-4900-bd8c-d2c5fcf3f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume 47fda811-792b-4670-b651-147df461711a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47fda811-792b-4670-b651-147df461711a', 'volume_size': 2, 'snapshot_id': '7a6be18e-7a93-45de-8280-42a283b345d4'} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-7a6be18e-7a93-45de-8280-42a283b345d4-47fda811-792b-4670-b651-147df461711a" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-7a6be18e-7a93-45de-8280-42a283b345d4-47fda811-792b-4670-b651-147df461711a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating volume 47fda811-792b-4670-b651-147df461711a from snapshot 7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-47fda811-792b-4670-b651-147df461711a" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-47fda811-792b-4670-b651-147df461711a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] snapshot: 7a6be18e-7a93-45de-8280-42a283b345d4, volume: 47fda811-792b-4670-b651-147df461711a, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[81854bce-882b-4971-a2f3-b62883a7c41e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:37 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 Jul 31 11:04:37 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:37 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a0e9f74-ce00-436c-b160-9c03dba096b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:04:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:04:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b24f55-a31a-45d0-9f62-128a32136f24]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:38 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:38 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:38 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.418s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:38 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:04:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:38 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a Jul 31 11:04:38 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=170,cinder:DELETE=18,cinder:SELECT=152,cinder:INSERT=55 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=151,cinder:UPDATE=170,cinder:INSERT=66,cinder:DELETE=12 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (5654d946-1032-4461-9fd1-0314f9e72399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074cc1e1-9356-4c08-a4a1-06df8d78755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074cc1e1-9356-4c08-a4a1-06df8d78755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097167496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbebad8-ddd2-4d92-9aa0-8d74ef31b203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:40Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f007be60-9cdc-4b21-a226-429a608c1e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f007be60-9cdc-4b21-a226-429a608c1e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb9442-e6e7-43b3-9d09-dd29a60f2e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb9442-e6e7-43b3-9d09-dd29a60f2e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbebad8-ddd2-4d92-9aa0-8d74ef31b203', 'volume_name': 'volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56810a09-a34e-46a4-89d4-e45a426d6c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56810a09-a34e-46a4-89d4-e45a426d6c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c233159a-3f8d-4f96-950b-dff67e2f02b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:39 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Volume 4fbebad8-ddd2-4d92-9aa0-8d74ef31b203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203', 'volume_size': 1} Jul 31 11:04:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:43 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a" returned: 0 in 4.729s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:43 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea3e37a-11bc-47db-ad88-4dd0b3ec18ed]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:43 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:43 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:43 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.541s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:43 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:04:43 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Converted 1024.00 MB image at 216.49 MB/s Jul 31 11:04:43 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a is being set with open permissions: ugo+rw Jul 31 11:04:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:43 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a Jul 31 11:04:43 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:44 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a" returned: 0 in 0.403s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-47fda811-792b-4670-b651-147df461711a" released by "_copy_volume_from_snapshot" :: held 6.558s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-7a6be18e-7a93-45de-8280-42a283b345d4-47fda811-792b-4670-b651-147df461711a" released by "_create_volume_from_snapshot" :: held 6.598s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.618s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097167496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbebad8-ddd2-4d92-9aa0-8d74ef31b203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:40Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Creating volume 4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:44 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:44 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 1073741824 Jul 31 11:04:44 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5e828c-b25b-4900-bd8c-d2c5fcf3f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47fda811-792b-4670-b651-147df461711a', 'volume_size': 2, 'snapshot_id': '7a6be18e-7a93-45de-8280-42a283b345d4'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd93cf9-79ca-4a7c-afd2-4de032a73770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume volume-47fda811-792b-4670-b651-147df461711a (47fda811-792b-4670-b651-147df461711a): created successfully Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd93cf9-79ca-4a7c-afd2-4de032a73770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (379d3bac-e87e-4f07-959d-feb880a35694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4107e30c-5fba-4ebb-bf7e-d9871b63d4c1 tempest-VolumesSnapshotTestJSON-1813106956 None] Created volume successfully. Jul 31 11:04:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-d6ce86d8-0d8c-49bb-9f43-9bd0b4742143 req-22e3ac72-6f84-4156-8e24-521e5542dbdf tempest-TestShelveInstance-171741359 None] Terminate volume connection completed successfully. Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-d6ce86d8-0d8c-49bb-9f43-9bd0b4742143 req-22e3ac72-6f84-4156-8e24-521e5542dbdf tempest-TestShelveInstance-171741359 None] Deleting attachment 3cce2b0d-ad00-497a-a008-1901fe43acc3. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:04:44 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 1073741824" returned: 0 in 0.485s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:44 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 Jul 31 11:04:44 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:44 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203" returned: 0 in 0.247s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c233159a-3f8d-4f96-950b-dff67e2f02b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60c46ab-961c-4209-82a3-adad900c6948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Volume volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 (4fbebad8-ddd2-4d92-9aa0-8d74ef31b203): created successfully Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60c46ab-961c-4209-82a3-adad900c6948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (5654d946-1032-4461-9fd1-0314f9e72399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b8ba9dc1-d913-44e5-8117-663d98e32f01 tempest-ProjectReaderTests-1595929126 None] Created volume successfully. Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-47fda811-792b-4670-b651-147df461711a-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-47fda811-792b-4670-b651-147df461711a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-47fda811-792b-4670-b651-147df461711a" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-47fda811-792b-4670-b651-147df461711a" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbad936-e630-4452-92e9-9ac340122920]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:45 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a Jul 31 11:04:45 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:45 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a" returned: 0 in 0.346s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:45 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a Jul 31 11:04:45 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-47fda811-792b-4670-b651-147df461711a" returned: 0 in 0.276s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:45 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-47fda811-792b-4670-b651-147df461711a" released by "delete_volume" :: held 0.670s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['52838277-eb64-44ca-8d65-deb2e71cc661', '20cc89f8-e584-49e4-b6b8-627ad059a0e3', 'a8cfc260-9a48-48fc-a5a2-b3fd55447810', '270be8e3-0174-467a-90d9-930bea710fe4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Lock "cinder-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-quobyte-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203" acquired by "delete_volume" :: waited 0.043s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:46 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:46 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f56190-75ea-4db2-a2b7-83ecfe5d1edf]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:46 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 Jul 31 11:04:46 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:46 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.298s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-7a6be18e-7a93-45de-8280-42a283b345d4-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:46 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleted volume successfully. Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-7a6be18e-7a93-45de-8280-42a283b345d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-3a0e9f74-ce00-436c-b160-9c03dba096b4" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-442b7638-9993-43d5-b18e-b02e0b4ca628 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-47fda811-792b-4670-b651-147df461711a-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-3a0e9f74-ce00-436c-b160-9c03dba096b4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-7a6be18e-7a93-45de-8280-42a283b345d4" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-7a6be18e-7a93-45de-8280-42a283b345d4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleting offline snapshot 7a6be18e-7a93-45de-8280-42a283b345d4 of volume 3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] snapshot_file for this snap is: volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[520986c1-d544-4f7e-ba1b-23ee348d2dec]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:46 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:46 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:46 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203" returned: 0 in 0.455s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:46 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 Jul 31 11:04:46 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:46 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203 Jul 31 11:04:46 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:46 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.283s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:04:46 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203" released by "delete_volume" :: held 0.797s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:46 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4" returned: 0 in 0.396s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a0e9f74-ce00-436c-b160-9c03dba096b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f445770-7254-4f89-9424-e0d8a31c3823]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Created reservations ['eef03d73-36ba-4c7f-bb90-f484a27f0f6a', '0b071ac7-775b-4bdd-b1b4-14b34fba2319', '8bf0de68-ee69-4985-843a-045e635c0b91', '22b9d4d0-8a42-45e1-802f-6b7cd8626864'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:47 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:47 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:47 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:47 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:47 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Deleted volume successfully. Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-57c56905-8d23-42ee-805c-a8e39209814b tempest-ProjectReaderTests-1595929126 None] Lock "cinder-4fbebad8-ddd2-4d92-9aa0-8d74ef31b203-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:47 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.577s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:47 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 Jul 31 11:04:47 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381da38-b489-4841-8980-19bebd40520d]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (2eccd421-e89a-4117-a7e7-baed35e1112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4423e0-fb38-4273-94ac-48961d13c22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4423e0-fb38-4273-94ac-48961d13c22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377143309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ef0829-2161-4419-9c49-d9a7d1aba2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:48Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1859c897-e39e-4be0-99d6-c480686f206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1859c897-e39e-4be0-99d6-c480686f206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560e4092-8c89-4153-853d-038b923746f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560e4092-8c89-4153-853d-038b923746f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ef0829-2161-4419-9c49-d9a7d1aba2fa', 'volume_name': 'volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b1e922-04d8-4382-bdb8-19e8c77e23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:47 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b1e922-04d8-4382-bdb8-19e8c77e23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79b1f48-cdab-46eb-aae0-32112462eb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Volume b1ef0829-2161-4419-9c49-d9a7d1aba2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa', 'volume_size': 1} Jul 31 11:04:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4" returned: 0 in 0.412s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:48 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:04:48 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:48 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4 Jul 31 11:04:48 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:48 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4.7a6be18e-7a93-45de-8280-42a283b345d4" returned: 0 in 0.242s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:48 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 0.362s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-7a6be18e-7a93-45de-8280-42a283b345d4" released by "_delete_snapshot" :: held 1.754s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-3a0e9f74-ce00-436c-b160-9c03dba096b4" released by "delete_snapshot" :: held 1.781s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['e8e028ca-20aa-4a55-aa82-4d69a0e98eac', 'ec7d729d-9e87-4374-a316-9cfc220c571f', '356652fc-4fd9-426f-ac26-ebbb56a119f6', '1952e149-f002-4229-89a2-2458eda8e2f1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:48 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:04:48 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Delete snapshot completed successfully. Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a6b6860e-bda9-491d-b697-0b2d98259bb8 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-7a6be18e-7a93-45de-8280-42a283b345d4-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:48 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 1 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377143309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ef0829-2161-4419-9c49-d9a7d1aba2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:48Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Creating volume b1ef0829-2161-4419-9c49-d9a7d1aba2fa {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:48 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:48 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa 1073741824 Jul 31 11:04:48 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-592c51ce-e16d-4b85-8901-e15a412df179', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be4482c5-9ab8-425a-8961-3cc61b96180e', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:04:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-ce8eee14-ecc1-4bdb-ba7f-b2916b379ee0 req-170b72eb-7ca4-4858-9609-e10cd40d8741 tempest-TestShelveInstance-171741359 None] attachment_update completed successfully. Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-3a0e9f74-ce00-436c-b160-9c03dba096b4-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-3a0e9f74-ce00-436c-b160-9c03dba096b4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-3a0e9f74-ce00-436c-b160-9c03dba096b4" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-3a0e9f74-ce00-436c-b160-9c03dba096b4" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05565ec-0d0a-43eb-9089-4860011363a6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:49 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:49 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:49 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa 1073741824" returned: 0 in 0.651s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:49 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa Jul 31 11:04:49 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:49 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.430s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:49 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4 Jul 31 11:04:49 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:49 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79b1f48-cdab-46eb-aae0-32112462eb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb9ea1b-f79d-4d34-867f-a872c718e6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:49 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3a0e9f74-ce00-436c-b160-9c03dba096b4" returned: 0 in 0.253s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:49 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Volume volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa (b1ef0829-2161-4419-9c49-d9a7d1aba2fa): created successfully Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb9ea1b-f79d-4d34-867f-a872c718e6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (2eccd421-e89a-4117-a7e7-baed35e1112c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-3a0e9f74-ce00-436c-b160-9c03dba096b4" released by "delete_volume" :: held 0.772s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3a8a6940-dbf8-4c0e-a631-25914d2325e8 tempest-ProjectReaderTests-1595929126 None] Created volume successfully. Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['3a746c80-cbbc-41c1-a646-8dda8ad150b8', '6b2f93c3-bb7b-488d-8883-1ef899540493', '54f1448b-ec11-41a1-86b9-a7278b03484e', '35b99017-8e1d-4186-8cb3-5b1de95a188b'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:49 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:49 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:50 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.282s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleted volume successfully. Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-b1ef0829-2161-4419-9c49-d9a7d1aba2fa-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b20baed0-ddc7-47ab-9f49-fe33f92c9584 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-3a0e9f74-ce00-436c-b160-9c03dba096b4-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Lock "cinder-b1ef0829-2161-4419-9c49-d9a7d1aba2fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-quobyte-b1ef0829-2161-4419-9c49-d9a7d1aba2fa" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-b1ef0829-2161-4419-9c49-d9a7d1aba2fa" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[92446344-b9fc-451c-9094-62ebc8b292dd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:50 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa Jul 31 11:04:50 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:50 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (8a9e7995-82b3-4d0e-99b2-e85c6d32c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4445187f-b372-4545-84fb-74fc71ab3c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa" returned: 0 in 0.516s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4445187f-b372-4545-84fb-74fc71ab3c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1027749261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad369b67-86cc-4f79-9743-bf704624a777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:51Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae96312-746d-4836-8924-b6039009bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:50 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa Jul 31 11:04:50 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae96312-746d-4836-8924-b6039009bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faef6e03-f455-420e-8b20-808678d1bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faef6e03-f455-420e-8b20-808678d1bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad369b67-86cc-4f79-9743-bf704624a777', 'volume_name': 'volume-ad369b67-86cc-4f79-9743-bf704624a777', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b5a51-886f-4bf3-a98d-79acf356d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38b5a51-886f-4bf3-a98d-79acf356d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9008604c-906b-4e74-9bb6-5caf63d24cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume ad369b67-86cc-4f79-9743-bf704624a777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad369b67-86cc-4f79-9743-bf704624a777', 'volume_size': 1} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1027749261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad369b67-86cc-4f79-9743-bf704624a777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:51Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating volume ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:50 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:50 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 1073741824 Jul 31 11:04:50 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:51 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b1ef0829-2161-4419-9c49-d9a7d1aba2fa" returned: 0 in 0.322s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-b1ef0829-2161-4419-9c49-d9a7d1aba2fa" released by "delete_volume" :: held 0.895s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Created reservations ['5fc05d9f-3100-497c-a005-2c74f1716be2', '135d2194-56b4-4b34-99d2-4abfcc83ae35', '61159bbb-824d-4a00-8a12-1b48e16b34d4', 'aae9e15d-618f-478d-b7ba-15bfae766e46'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:51 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:51 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:51 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 1073741824" returned: 0 in 0.566s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:51 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:04:51 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:51 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.358s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Deleted volume successfully. Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-95f133e9-7bd2-4526-b182-5d7232657bbd tempest-ProjectReaderTests-1595929126 None] Lock "cinder-b1ef0829-2161-4419-9c49-d9a7d1aba2fa-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:51 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.473s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9008604c-906b-4e74-9bb6-5caf63d24cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad369b67-86cc-4f79-9743-bf704624a777', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e462fa7-55e4-4c8a-a076-51e1d9a5717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:51 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Volume volume-ad369b67-86cc-4f79-9743-bf704624a777 (ad369b67-86cc-4f79-9743-bf704624a777): created successfully Jul 31 11:04:51 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e462fa7-55e4-4c8a-a076-51e1d9a5717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (8a9e7995-82b3-4d0e-99b2-e85c6d32c001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5f35804c-a0d1-4316-bd64-df157ce1cbf5 tempest-VolumesSnapshotTestJSON-1813106956 None] Created volume successfully. Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (265fc9b8-17af-4732-aa0b-12c6fb95ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031566de-5f60-49fc-b28d-64c6b7d0a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031566de-5f60-49fc-b28d-64c6b7d0a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666827141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4d9371-eadb-41e4-8a13-f9245f7c72df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:52Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5af515-bc48-49ff-8c95-f5c9efd2d1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5af515-bc48-49ff-8c95-f5c9efd2d1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9948cb5-2d71-41e5-a830-d34d56f34a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9948cb5-2d71-41e5-a830-d34d56f34a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4d9371-eadb-41e4-8a13-f9245f7c72df', 'volume_name': 'volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c78d189-fd3d-4f0e-9ff5-6180ba22e350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c78d189-fd3d-4f0e-9ff5-6180ba22e350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6a6bae-6517-413f-abbd-1aa171763cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:52 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Volume 0a4d9371-eadb-41e4-8a13-f9245f7c72df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df', 'volume_size': 1} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1666827141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4d9371-eadb-41e4-8a13-f9245f7c72df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:52Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Creating volume 0a4d9371-eadb-41e4-8a13-f9245f7c72df {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:52 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:52 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df 1073741824 Jul 31 11:04:52 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:53 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df 1073741824" returned: 0 in 0.729s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:53 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df Jul 31 11:04:53 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:53 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df" returned: 0 in 0.286s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.267s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Creating offline snapshot 468a619c-7a1d-4f0c-bab0-bba162a1fef2 of volume ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6a6bae-6517-413f-abbd-1aa171763cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1df98bd-1e64-4ad8-bdc8-f80f3e3defd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94daec-9ace-40cf-9e81-95a0f58316aa]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:53 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Volume volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df (0a4d9371-eadb-41e4-8a13-f9245f7c72df): created successfully Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1df98bd-1e64-4ad8-bdc8-f80f3e3defd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (265fc9b8-17af-4732-aa0b-12c6fb95ffee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-316ea5a7-bdf6-463a-bf93-bd554ac83393 tempest-ProjectReaderTests-1595929126 None] Created volume successfully. Jul 31 11:04:53 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:04:53 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:53 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.384s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:53 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 1G Jul 31 11:04:53 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-0a4d9371-eadb-41e4-8a13-f9245f7c72df-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Lock "cinder-0a4d9371-eadb-41e4-8a13-f9245f7c72df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-quobyte-0a4d9371-eadb-41e4-8a13-f9245f7c72df" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-0a4d9371-eadb-41e4-8a13-f9245f7c72df" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a09c406-aca8-44a3-8410-23843b04bc88]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:54 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df Jul 31 11:04:54 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:54 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 1G" returned: 0 in 0.481s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad369b67-86cc-4f79-9743-bf704624a777 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:54 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad369b67-86cc-4f79-9743-bf704624a777 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 Jul 31 11:04:54 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:54 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df" returned: 0 in 0.501s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:54 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df Jul 31 11:04:54 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:54 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad369b67-86cc-4f79-9743-bf704624a777 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:54 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 is being set with open permissions: ugo+rw Jul 31 11:04:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:54 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 Jul 31 11:04:54 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:55 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0a4d9371-eadb-41e4-8a13-f9245f7c72df" returned: 0 in 0.321s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-0a4d9371-eadb-41e4-8a13-f9245f7c72df" released by "delete_volume" :: held 0.876s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:55 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2" returned: 0 in 0.290s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Created reservations ['08e12052-4daf-4395-9bb8-462a3e2106ea', '2190335e-f423-4dd6-befb-9284a3d8cf04', '4e18a64c-560d-4e0a-9956-2ea3b2c3b686', '089c9368-ec45-4bee-a413-4b3c71e3af6d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:55 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info Jul 31 11:04:55 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:55 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:04:55 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:55 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info" returned: 0 in 0.355s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:55 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info is being set with open permissions: ugo+rw Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:55 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info Jul 31 11:04:55 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:55 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:04:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Deleted volume successfully. Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5c4c48d3-657a-44fe-ac34-984927fb40ac tempest-ProjectReaderTests-1595929126 None] Lock "cinder-0a4d9371-eadb-41e4-8a13-f9245f7c72df-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:55 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.info" returned: 0 in 0.381s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1d255fe2-9de2-4564-a0db-24685d5fa4f3 tempest-VolumesSnapshotTestJSON-1813106956 None] Create snapshot completed successfully Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (303de9af-fc14-4479-91d6-f0ad91f031cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7738c8-d10c-488b-90cc-0fe178b00281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7738c8-d10c-488b-90cc-0fe178b00281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107363069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b185dcf1-1668-467d-a3b0-80c7dac8010c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:56Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e02ff5-35ec-4365-9fa7-fea56121f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e02ff5-35ec-4365-9fa7-fea56121f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142f028e-b62f-42c7-93d8-ef874bd22ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142f028e-b62f-42c7-93d8-ef874bd22ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b185dcf1-1668-467d-a3b0-80c7dac8010c', 'volume_name': 'volume-b185dcf1-1668-467d-a3b0-80c7dac8010c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598c55a8-903c-4105-b16a-13a0161c9527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598c55a8-903c-4105-b16a-13a0161c9527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f0bee6-f10b-4c3d-9c1c-a699227ada3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Volume b185dcf1-1668-467d-a3b0-80c7dac8010c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b185dcf1-1668-467d-a3b0-80c7dac8010c', 'volume_size': 1} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107363069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b185dcf1-1668-467d-a3b0-80c7dac8010c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b77768ac94c70bd1d89f99ae8c16d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:56Z,use_quota=True,user_id='effad77b82124f169c02743220a3b321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Creating volume b185dcf1-1668-467d-a3b0-80c7dac8010c {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:56 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c 1073741824 Jul 31 11:04:56 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:56 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c 1073741824" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:56 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c Jul 31 11:04:56 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:57 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c" returned: 0 in 0.346s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f0bee6-f10b-4c3d-9c1c-a699227ada3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b185dcf1-1668-467d-a3b0-80c7dac8010c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f4048e-0e1d-4448-bfc1-d63aaf751f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Volume volume-b185dcf1-1668-467d-a3b0-80c7dac8010c (b185dcf1-1668-467d-a3b0-80c7dac8010c): created successfully Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f4048e-0e1d-4448-bfc1-d63aaf751f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Flow 'volume_create_manager' (303de9af-fc14-4479-91d6-f0ad91f031cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ade0217d-3c0e-4137-a81b-7c04f873444e tempest-ProjectReaderTests-1595929126 None] Created volume successfully. Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (88c8cf01-53c9-47f0-aac5-e60e3136f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533b1d75-30fa-4c22-819e-45e6768bf78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533b1d75-30fa-4c22-819e-45e6768bf78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-581538693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625f0cae-a85b-48bf-b6b4-7d607e72c179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ce337a7c8449eab5caf4929c44b275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=468a619c-7a1d-4f0c-bab0-bba162a1fef2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:04:57Z,use_quota=True,user_id='4b2b69abfbaf443196f7bbc140e5c711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de26ca8-3858-4c6d-b99c-16746793094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de26ca8-3858-4c6d-b99c-16746793094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cfe3e5-4328-4a12-a7df-738b0230b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cfe3e5-4328-4a12-a7df-738b0230b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '625f0cae-a85b-48bf-b6b4-7d607e72c179', 'volume_name': 'volume-625f0cae-a85b-48bf-b6b4-7d607e72c179', 'volume_size': 1, 'snapshot_id': '468a619c-7a1d-4f0c-bab0-bba162a1fef2'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94be6cc9-1f9d-4091-8941-15fdfd8c0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94be6cc9-1f9d-4091-8941-15fdfd8c0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9fe5a5-b8b2-4e94-90f6-cbe2442e3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:04:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Volume 625f0cae-a85b-48bf-b6b4-7d607e72c179: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-625f0cae-a85b-48bf-b6b4-7d607e72c179', 'volume_size': 1, 'snapshot_id': '468a619c-7a1d-4f0c-bab0-bba162a1fef2'} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-468a619c-7a1d-4f0c-bab0-bba162a1fef2-625f0cae-a85b-48bf-b6b4-7d607e72c179" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-468a619c-7a1d-4f0c-bab0-bba162a1fef2-625f0cae-a85b-48bf-b6b4-7d607e72c179" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Creating volume 625f0cae-a85b-48bf-b6b4-7d607e72c179 from snapshot 468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-625f0cae-a85b-48bf-b6b4-7d607e72c179" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-625f0cae-a85b-48bf-b6b4-7d607e72c179" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] snapshot: 468a619c-7a1d-4f0c-bab0-bba162a1fef2, volume: 625f0cae-a85b-48bf-b6b4-7d607e72c179, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d05f846-bbe8-4127-a0ca-9ee79ea70090]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:57 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 Jul 31 11:04:57 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:57 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad369b67-86cc-4f79-9743-bf704624a777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c7e98-546e-42ac-8924-bed14d46ad2e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:57 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:04:57 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:58 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.420s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-b185dcf1-1668-467d-a3b0-80c7dac8010c-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:58 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 Jul 31 11:04:58 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Lock "cinder-b185dcf1-1668-467d-a3b0-80c7dac8010c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "cinder-quobyte-b185dcf1-1668-467d-a3b0-80c7dac8010c" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-b185dcf1-1668-467d-a3b0-80c7dac8010c" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d560f-f3b3-4d75-847c-0c031401af13]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:58 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c Jul 31 11:04:58 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:58 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:04:58 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c Jul 31 11:04:58 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:04:59 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b185dcf1-1668-467d-a3b0-80c7dac8010c" returned: 0 in 0.708s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Lock "cinder-quobyte-b185dcf1-1668-467d-a3b0-80c7dac8010c" released by "delete_volume" :: held 1.216s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Created reservations ['f30cc341-80ee-4b19-879d-980528b6605f', '1e6f5a82-382f-45d5-8f5b-8cda2e40c1a6', 'f2eeb8d3-64df-4ec9-8b10-24bbe1885bad', '5186821d-98c5-4132-bfc5-8ac1d35b0fdc'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:04:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:00 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:05:00 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:00 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 1.014s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:00 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Deleted volume successfully. Jul 31 11:05:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ecac118a-c116-4d75-8640-8db8fc68a1b7 tempest-ProjectReaderTests-1595929126 None] Lock "cinder-b185dcf1-1668-467d-a3b0-80c7dac8010c-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:04 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179" returned: 0 in 6.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ab4b6c-7667-4371-8e1e-c18b0ed5880d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:04 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:05:04 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:05 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.573s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:05:05 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Converted 1024.00 MB image at 162.25 MB/s Jul 31 11:05:05 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 is being set with open permissions: ugo+rw Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:05 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 Jul 31 11:05:05 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:05 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179" returned: 0 in 0.294s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-625f0cae-a85b-48bf-b6b4-7d607e72c179" released by "_copy_volume_from_snapshot" :: held 8.069s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-468a619c-7a1d-4f0c-bab0-bba162a1fef2-625f0cae-a85b-48bf-b6b4-7d607e72c179" released by "_create_volume_from_snapshot" :: held 8.105s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.126s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9fe5a5-b8b2-4e94-90f6-cbe2442e3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625f0cae-a85b-48bf-b6b4-7d607e72c179', 'volume_size': 1, 'snapshot_id': '468a619c-7a1d-4f0c-bab0-bba162a1fef2'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf5bd7f-e01f-4db9-86a6-ee0ad1f5953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:05 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Volume volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 (625f0cae-a85b-48bf-b6b4-7d607e72c179): created successfully Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf5bd7f-e01f-4db9-86a6-ee0ad1f5953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Flow 'volume_create_manager' (88c8cf01-53c9-47f0-aac5-e60e3136f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-915bce48-8be2-4c85-acff-3519a5ffca6a tempest-VolumesSnapshotTestJSON-1813106956 None] Created volume successfully. Jul 31 11:05:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-625f0cae-a85b-48bf-b6b4-7d607e72c179-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-625f0cae-a85b-48bf-b6b4-7d607e72c179-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-625f0cae-a85b-48bf-b6b4-7d607e72c179" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-625f0cae-a85b-48bf-b6b4-7d607e72c179" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[416548a1-a34c-446d-9c16-4bda83b3c07e]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:06 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 Jul 31 11:05:06 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:07 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179" returned: 0 in 0.443s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:07 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179 Jul 31 11:05:07 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:07 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-625f0cae-a85b-48bf-b6b4-7d607e72c179" returned: 0 in 0.287s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-625f0cae-a85b-48bf-b6b4-7d607e72c179" released by "delete_volume" :: held 0.774s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['5536a625-c32b-4ffc-9d05-a9e0e6ece6a9', '6302bea3-7a05-483c-9edc-a0950d5f5423', '7837d6b4-3945-4f1c-86f6-ed2c75e4396d', '953caa5f-4352-4a5a-b680-bd2e860f4a65'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:07 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:05:07 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-468a619c-7a1d-4f0c-bab0-bba162a1fef2-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-468a619c-7a1d-4f0c-bab0-bba162a1fef2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-ad369b67-86cc-4f79-9743-bf704624a777" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:07 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-ad369b67-86cc-4f79-9743-bf704624a777" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-468a619c-7a1d-4f0c-bab0-bba162a1fef2" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleted volume successfully. Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-468a619c-7a1d-4f0c-bab0-bba162a1fef2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleting offline snapshot 468a619c-7a1d-4f0c-bab0-bba162a1fef2 of volume ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] snapshot_file for this snap is: volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d8074107-0e42-494b-a732-65d229fec354 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-625f0cae-a85b-48bf-b6b4-7d607e72c179-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[af57ad48-8571-4906-9625-e4cf4297d265]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:08 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 Jul 31 11:05:08 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:08 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2" returned: 0 in 0.441s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad369b67-86cc-4f79-9743-bf704624a777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:05:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced6688-5148-4634-a051-9b0f6f97b033]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:08 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:05:08 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:08 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:08 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 Jul 31 11:05:08 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:09 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2" returned: 0 in 0.393s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:09 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2 Jul 31 11:05:09 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:09 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777.468a619c-7a1d-4f0c-bab0-bba162a1fef2" returned: 0 in 0.284s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-468a619c-7a1d-4f0c-bab0-bba162a1fef2" released by "_delete_snapshot" :: held 1.598s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-ad369b67-86cc-4f79-9743-bf704624a777" released by "delete_snapshot" :: held 1.628s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['548dd7da-060d-4ee3-944a-4b0a93998667', '579e8b05-5077-4df5-b2fc-85fef9114346', '159762f2-0a5a-4f5a-b2e9-34f8dd412823', 'd3c3daf9-775a-4109-85b4-ccf13a124451'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:05:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Delete snapshot completed successfully. Jul 31 11:05:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3b9e787-07cb-4727-a0cc-aa42375f1c66 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-468a619c-7a1d-4f0c-bab0-bba162a1fef2-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-ad369b67-86cc-4f79-9743-bf704624a777-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-ad369b67-86cc-4f79-9743-bf704624a777-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-ad369b67-86cc-4f79-9743-bf704624a777" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-ad369b67-86cc-4f79-9743-bf704624a777" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[626062a4-72b0-4751-8012-d681f4fafb26]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:10 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:05:10 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:10 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.391s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:10 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777 Jul 31 11:05:10 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:10 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ad369b67-86cc-4f79-9743-bf704624a777" returned: 0 in 0.239s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-ad369b67-86cc-4f79-9743-bf704624a777" released by "delete_volume" :: held 0.689s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['f44b9503-7863-40a1-b9aa-67cc12513c87', 'b85c0a9c-7748-4b40-93a2-c832ee352695', '031fbd45-888d-4d53-b582-b8003ffde01e', 'd738f78e-b0e9-405a-a0e0-a78f5c4d2f27'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:10 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:05:10 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:11 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.256s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Deleted volume successfully. Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0d06e24c-5e1a-4e00-83fb-767812d75804 tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-ad369b67-86cc-4f79-9743-bf704624a777-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-f852cc5b-3352-43c8-b5d6-2365176e338b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-f852cc5b-3352-43c8-b5d6-2365176e338b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "cinder-quobyte-f852cc5b-3352-43c8-b5d6-2365176e338b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-f852cc5b-3352-43c8-b5d6-2365176e338b" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94dd609-5d27-4654-8aff-6d5f5fc59466]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:11 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b Jul 31 11:05:11 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:11 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b" returned: 0 in 0.366s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:11 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b Jul 31 11:05:11 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:11 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f852cc5b-3352-43c8-b5d6-2365176e338b" returned: 0 in 0.247s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-quobyte-f852cc5b-3352-43c8-b5d6-2365176e338b" released by "delete_volume" :: held 0.671s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Created reservations ['800738a2-46e8-417c-ae25-5ee3b22a3dfc', '6f52b021-52d9-49a8-8e8b-a97e8dfd0c33', 'bdd38869-67ef-4909-af75-d64d3da519cc', '930ea317-02b0-4f2f-a1d0-29afdeec1a4f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:12 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:05:12 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:12 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:12 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Deleted volume successfully. Jul 31 11:05:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0c9ececd-caa8-4f6f-829a-282b6f12137a tempest-VolumesSnapshotTestJSON-1813106956 None] Lock "cinder-f852cc5b-3352-43c8-b5d6-2365176e338b-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:22 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=104,cinder:SELECT=80,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:22 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=78,cinder:UPDATE=105,cinder:DELETE=10,cinder:INSERT=24 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-9ee5a529-f334-4c1a-a45e-c69ba7f305b7 tempest-TestShelveInstance-171741359 None] Terminate volume connection completed successfully. Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-9ee5a529-f334-4c1a-a45e-c69ba7f305b7 tempest-TestShelveInstance-171741359 None] Deleting attachment be4482c5-9ab8-425a-8961-3cc61b96180e. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Acquiring lock "cinder-592c51ce-e16d-4b85-8901-e15a412df179-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Lock "cinder-592c51ce-e16d-4b85-8901-e15a412df179-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Acquiring lock "cinder-quobyte-592c51ce-e16d-4b85-8901-e15a412df179" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Lock "cinder-quobyte-592c51ce-e16d-4b85-8901-e15a412df179" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45d450e-b9bd-4d5b-8ea4-d6cc950bfe0e]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:37 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:05:37 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:38 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 0.456s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:38 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:05:38 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:38 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 1 in 0.383s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:38 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179 Jul 31 11:05:38 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:38 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-592c51ce-e16d-4b85-8901-e15a412df179" returned: 0 in 0.284s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Lock "cinder-quobyte-592c51ce-e16d-4b85-8901-e15a412df179" released by "delete_volume" :: held 1.237s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:38 devstack cinder-volume[88837]: DEBUG cinder.quota [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Created reservations ['d6af2d51-289e-4f24-96a2-e01a61fd3ba3', '1df55a7b-9010-4dbe-a617-9d701e074d9e', 'f393bc62-563f-4d81-a936-3dbfb553fa5d', '7c7f0a27-5c20-4a25-9b5f-a1ffddd52523'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:39 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:05:39 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:39 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.303s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG cinder.manager [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Deleted volume successfully. Jul 31 11:05:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [req-b9b79053-c3e0-42ec-94da-008b853a91b1 req-d48018a4-1cb4-4c9b-ad30-bec75a405761 tempest-TestShelveInstance-171741359 None] Lock "cinder-592c51ce-e16d-4b85-8901-e15a412df179-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:46 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:05:46 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:46 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.274s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:05:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Flow 'volume_create_manager' (b099a4a5-bc04-42fd-847c-a669ad85ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0cf59e-78b1-4629-a723-106b56cfd26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0cf59e-78b1-4629-a723-106b56cfd26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-53603153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ce033d-a0a2-40de-ab6a-41122755dc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4a302ce664469da40fa3151689fccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:05:50Z,use_quota=True,user_id='53b0a84d6c48483e867392b578b330d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:49 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78122682-5fc5-414f-8b96-ee61f49a476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78122682-5fc5-414f-8b96-ee61f49a476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8a1c8d-d1e2-45f9-8dfb-d6432bb258cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8a1c8d-d1e2-45f9-8dfb-d6432bb258cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ce033d-a0a2-40de-ab6a-41122755dc0b', 'volume_name': 'volume-77ce033d-a0a2-40de-ab6a-41122755dc0b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255f198d-2595-40d4-b587-ebcd2646be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255f198d-2595-40d4-b587-ebcd2646be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8f861-0fd5-4ae2-90da-48af4cb8df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Volume 77ce033d-a0a2-40de-ab6a-41122755dc0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ce033d-a0a2-40de-ab6a-41122755dc0b', 'volume_size': 1} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-53603153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ce033d-a0a2-40de-ab6a-41122755dc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a4a302ce664469da40fa3151689fccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:05:50Z,use_quota=True,user_id='53b0a84d6c48483e867392b578b330d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Creating volume 77ce033d-a0a2-40de-ab6a-41122755dc0b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:05:50 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:50 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b 1073741824 Jul 31 11:05:50 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:50 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b 1073741824" returned: 0 in 0.545s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:50 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b Jul 31 11:05:50 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:50 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b" returned: 0 in 0.260s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8f861-0fd5-4ae2-90da-48af4cb8df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ce033d-a0a2-40de-ab6a-41122755dc0b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd68a5d4-292e-4ee3-8080-6513d1acfda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:05:50 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Volume volume-77ce033d-a0a2-40de-ab6a-41122755dc0b (77ce033d-a0a2-40de-ab6a-41122755dc0b): created successfully Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd68a5d4-292e-4ee3-8080-6513d1acfda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:05:50 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Flow 'volume_create_manager' (b099a4a5-bc04-42fd-847c-a669ad85ee76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:05:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f69094a5-8d1b-42e1-8bbe-a0e06068a820 tempest-TestMinimumBasicScenario-1379486253 None] Created volume successfully. Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[43207bc7-f705-4134-b22e-e3109db01b79]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:05:53 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b Jul 31 11:05:53 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:05:53 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b" returned: 0 in 0.484s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:05:53 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-77ce033d-a0a2-40de-ab6a-41122755dc0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f533346e-669c-4490-aadc-b0805bd25820', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:05:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-81daa211-76f8-4624-9131-0322ccdbc54f req-dc410e39-fdff-4b9e-b4aa-528e8e1d143f tempest-TestMinimumBasicScenario-1379486253 None] attachment_update completed successfully. Jul 31 11:06:03 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:03 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Flow 'volume_create_manager' (c8dc74d3-c0db-417f-b19b-a13940e5b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4952ff-9581-4f16-ae1b-8f8ba642ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4952ff-9581-4f16-ae1b-8f8ba642ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-996595058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceda18e5-0e89-4120-9ebf-d0e44502b944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e08daea17e4956a44dd53e8bdc0d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:14Z,use_quota=True,user_id='0c1a4a3f1b364766af886f90c0ae9c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ffd174-1d48-4c27-9699-cb8310be2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ffd174-1d48-4c27-9699-cb8310be2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1ff655-ae41-4d35-b3b0-1b2aadb3f42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1ff655-ae41-4d35-b3b0-1b2aadb3f42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceda18e5-0e89-4120-9ebf-d0e44502b944', 'volume_name': 'volume-ceda18e5-0e89-4120-9ebf-d0e44502b944', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2c0441-8737-4eac-a565-25bfbfa525b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2c0441-8737-4eac-a565-25bfbfa525b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce913f5b-986c-46b8-97f1-683295f7ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:13 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Volume ceda18e5-0e89-4120-9ebf-d0e44502b944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceda18e5-0e89-4120-9ebf-d0e44502b944', 'volume_size': 1} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-996595058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceda18e5-0e89-4120-9ebf-d0e44502b944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e08daea17e4956a44dd53e8bdc0d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:06:14Z,use_quota=True,user_id='0c1a4a3f1b364766af886f90c0ae9c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Creating volume ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:06:13 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:06:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:13 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 1073741824 Jul 31 11:06:13 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:14 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 1073741824" returned: 0 in 0.442s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:14 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 Jul 31 11:06:14 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:14 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944" returned: 0 in 0.251s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce913f5b-986c-46b8-97f1-683295f7ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceda18e5-0e89-4120-9ebf-d0e44502b944', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4d87dd-b1b5-4325-b069-a82bfc6c52e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:06:14 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Volume volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 (ceda18e5-0e89-4120-9ebf-d0e44502b944): created successfully Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4d87dd-b1b5-4325-b069-a82bfc6c52e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:06:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Flow 'volume_create_manager' (c8dc74d3-c0db-417f-b19b-a13940e5b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:06:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-07d9d577-63b2-488d-8b1a-d2d1c11c8345 tempest-TestImageHashVerification-349748751 None] Created volume successfully. Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd57823-e598-4656-9d02-df6c3be95aad]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:15 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 Jul 31 11:06:15 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:15 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fefe93-92b0-4711-83d5-80d462795aa3]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:15 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 Jul 31 11:06:15 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:16 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944" returned: 0 in 0.380s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 /opt/stack/data/cinder/conversion/ceda18e5-0e89-4120-9ebf-d0e44502b944.temp_image.263126ab-b20a-498c-8a42-442a3a766242k3qyztgr.img {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:16 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 /opt/stack/data/cinder/conversion/ceda18e5-0e89-4120-9ebf-d0e44502b944.temp_image.263126ab-b20a-498c-8a42-442a3a766242k3qyztgr.img Jul 31 11:06:16 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:21 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 /opt/stack/data/cinder/conversion/ceda18e5-0e89-4120-9ebf-d0e44502b944.temp_image.263126ab-b20a-498c-8a42-442a3a766242k3qyztgr.img" returned: 0 in 5.186s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2715201-34f6-42d3-b897-1667795850cf]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:21 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 Jul 31 11:06:21 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:21 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:21 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/conversion/ceda18e5-0e89-4120-9ebf-d0e44502b944.temp_image.263126ab-b20a-498c-8a42-442a3a766242k3qyztgr.img {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:06:21 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Converted 1024.00 MB image at 197.41 MB/s Jul 31 11:06:21 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] 263126ab-b20a-498c-8a42-442a3a766242 was raw, no need to convert to raw {{(pid=88837) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 31 11:06:31 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:31 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.095s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Uploaded volume to glance image-id: 263126ab-b20a-498c-8a42-442a3a766242. {{(pid=88837) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 31 11:06:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4973e970-aa6d-49e9-8407-7fbf4132bf24 tempest-TestImageHashVerification-349748751 None] Copy volume to image completed successfully. Jul 31 11:06:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-64b4fa6c-0331-48ce-9739-430d3d444aeb req-9db04623-74af-4c27-aea7-26e1d72cfd5f tempest-TestMinimumBasicScenario-1379486253 None] Terminate volume connection completed successfully. Jul 31 11:06:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-64b4fa6c-0331-48ce-9739-430d3d444aeb req-9db04623-74af-4c27-aea7-26e1d72cfd5f tempest-TestMinimumBasicScenario-1379486253 None] Deleting attachment f533346e-669c-4490-aadc-b0805bd25820. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Acquiring lock "cinder-ceda18e5-0e89-4120-9ebf-d0e44502b944-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Lock "cinder-ceda18e5-0e89-4120-9ebf-d0e44502b944-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Acquiring lock "cinder-quobyte-ceda18e5-0e89-4120-9ebf-d0e44502b944" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Lock "cinder-quobyte-ceda18e5-0e89-4120-9ebf-d0e44502b944" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73ce524-857b-486b-93fe-809bba1b5425]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Acquiring lock "cinder-77ce033d-a0a2-40de-ab6a-41122755dc0b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Lock "cinder-77ce033d-a0a2-40de-ab6a-41122755dc0b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:42 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 Jul 31 11:06:42 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Acquiring lock "cinder-quobyte-77ce033d-a0a2-40de-ab6a-41122755dc0b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Lock "cinder-quobyte-77ce033d-a0a2-40de-ab6a-41122755dc0b" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e5120b-e815-4fc3-8053-d341de12bda7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:42 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b Jul 31 11:06:42 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:42 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944" returned: 0 in 0.377s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:42 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944 Jul 31 11:06:42 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:42 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:42 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b Jul 31 11:06:42 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:43 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ceda18e5-0e89-4120-9ebf-d0e44502b944" returned: 0 in 0.251s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Lock "cinder-quobyte-ceda18e5-0e89-4120-9ebf-d0e44502b944" released by "delete_volume" :: held 0.674s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Created reservations ['e28e4610-d70f-415d-a38a-dc9069b9f9f5', 'e8499b01-6f3b-4f68-9e85-5032f43c6ec0', 'b2466f22-6841-4ef9-b25c-436f2cee38ae', '5edc1b26-5db1-435c-bafe-851110296a5d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:43 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:06:43 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:43 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-77ce033d-a0a2-40de-ab6a-41122755dc0b" returned: 0 in 0.273s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Lock "cinder-quobyte-77ce033d-a0a2-40de-ab6a-41122755dc0b" released by "delete_volume" :: held 0.706s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Created reservations ['67ef1c2b-9348-4961-984c-9bf07e380aee', '544dcae3-5053-46a8-bb3d-357a0fb275dc', '9e28954b-24fd-4a33-9a7a-7e1eb7318826', '3ed714f8-b044-4296-adc4-31ae27b913d5'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:43 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:06:43 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:43 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.265s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:06:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Deleted volume successfully. Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-86ca7f5f-e5eb-4270-8b90-91722524b908 tempest-TestImageHashVerification-349748751 None] Lock "cinder-ceda18e5-0e89-4120-9ebf-d0e44502b944-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:43 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:06:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Deleted volume successfully. Jul 31 11:06:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c3017c78-a0a7-4c09-bc95-188848c52d2d tempest-TestMinimumBasicScenario-1379486253 None] Lock "cinder-77ce033d-a0a2-40de-ab6a-41122755dc0b-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:06:46 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:06:46 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:06:46 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.316s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:06:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:06:53 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=14,cinder:SELECT=9,cinder:INSERT=4 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:06:53 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=14,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:07:10 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:07:10 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Flow 'volume_create_manager' (752d887f-74d5-466d-9fb9-bcca1f152a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25623b8-178d-4705-ad0c-273fa91cae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25623b8-178d-4705-ad0c-273fa91cae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1597007936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6d9ad2-085c-416f-a1c3-714ffbd2b668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef8cbed253f42439d26b8ee7f9f2385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:15Z,use_quota=True,user_id='239369d0f1f94542830896cb8c905487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf5ee3-d981-4bf6-9efa-7b23fbd5e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf5ee3-d981-4bf6-9efa-7b23fbd5e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb26afd-d8c8-4616-a4f5-98d1b26f4dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb26afd-d8c8-4616-a4f5-98d1b26f4dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6d9ad2-085c-416f-a1c3-714ffbd2b668', 'volume_name': 'volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484f97ac-5574-451a-9b54-1889107aac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484f97ac-5574-451a-9b54-1889107aac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f23bca3-668e-4a85-be22-c99e2cb5d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:15 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Volume bf6d9ad2-085c-416f-a1c3-714ffbd2b668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668', 'volume_size': 1} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1597007936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6d9ad2-085c-416f-a1c3-714ffbd2b668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef8cbed253f42439d26b8ee7f9f2385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:15Z,use_quota=True,user_id='239369d0f1f94542830896cb8c905487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Creating volume bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:15 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:15 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 1073741824 Jul 31 11:07:15 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:15 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 1073741824" returned: 0 in 0.470s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:15 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:15 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:16 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.254s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f23bca3-668e-4a85-be22-c99e2cb5d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8325a93a-7911-4635-83ea-cd9a927bd428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:16 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Volume volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 (bf6d9ad2-085c-416f-a1c3-714ffbd2b668): created successfully Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8325a93a-7911-4635-83ea-cd9a927bd428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Flow 'volume_create_manager' (752d887f-74d5-466d-9fb9-bcca1f152a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5d774d2d-ed35-4fb2-80ad-4e09caacdfe9 tempest-SnapshotDependencyTests-2120186358 None] Created volume successfully. Jul 31 11:07:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Creating offline snapshot a4f4cbef-cff7-41fe-8d87-c0485680a66e of volume bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:07:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ed685-0b8c-472f-a869-522b7706edec]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:17 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:17 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:18 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.392s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:18 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e 1G Jul 31 11:07:18 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:18 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e 1G" returned: 0 in 0.482s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:18 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e Jul 31 11:07:18 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:18 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e" returned: 0 in 0.398s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:18 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e is being set with open permissions: ugo+rw Jul 31 11:07:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:18 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e Jul 31 11:07:18 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:19 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e" returned: 0 in 0.258s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:19 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info Jul 31 11:07:19 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:19 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info" returned: 0 in 0.326s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:19 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info is being set with open permissions: ugo+rw Jul 31 11:07:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:19 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info Jul 31 11:07:19 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:19 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.info" returned: 0 in 0.260s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3d90f983-669d-4010-b8cd-7f6101bff729 tempest-SnapshotDependencyTests-2120186358 None] Create snapshot completed successfully Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Flow 'volume_create_manager' (a409bd5b-431e-42eb-a4f6-6828146ccf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9038e878-4a22-4358-98f8-4cc233051812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9038e878-4a22-4358-98f8-4cc233051812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4f555c-cf65-4b98-811b-737a9702ee30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef8cbed253f42439d26b8ee7f9f2385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4f4cbef-cff7-41fe-8d87-c0485680a66e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:21Z,use_quota=True,user_id='239369d0f1f94542830896cb8c905487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63482084-3377-46e6-b97f-16b32a62e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63482084-3377-46e6-b97f-16b32a62e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbed7fe-8627-4363-b5a6-9e275d9a81d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dbed7fe-8627-4363-b5a6-9e275d9a81d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca4f555c-cf65-4b98-811b-737a9702ee30', 'volume_name': 'volume-ca4f555c-cf65-4b98-811b-737a9702ee30', 'volume_size': 1, 'snapshot_id': 'a4f4cbef-cff7-41fe-8d87-c0485680a66e'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b60139-be35-451c-ad53-77b217498007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b60139-be35-451c-ad53-77b217498007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e901d80-63b5-4ea5-acd7-57057ec86e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:21 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Volume ca4f555c-cf65-4b98-811b-737a9702ee30: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca4f555c-cf65-4b98-811b-737a9702ee30', 'volume_size': 1, 'snapshot_id': 'a4f4cbef-cff7-41fe-8d87-c0485680a66e'} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-quobyte-a4f4cbef-cff7-41fe-8d87-c0485680a66e-ca4f555c-cf65-4b98-811b-737a9702ee30" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-a4f4cbef-cff7-41fe-8d87-c0485680a66e-ca4f555c-cf65-4b98-811b-737a9702ee30" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Creating volume ca4f555c-cf65-4b98-811b-737a9702ee30 from snapshot a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-quobyte-ca4f555c-cf65-4b98-811b-737a9702ee30" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-ca4f555c-cf65-4b98-811b-737a9702ee30" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] snapshot: a4f4cbef-cff7-41fe-8d87-c0485680a66e, volume: ca4f555c-cf65-4b98-811b-737a9702ee30, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45bd6ef-9f1b-4906-b0cf-a02723e637d2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:21 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e Jul 31 11:07:21 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:22 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e" returned: 0 in 0.414s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[55312c4d-c0a9-4bb4-a9f1-36b2ddc2a914]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:22 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:22 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:22 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:07:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:22 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 Jul 31 11:07:22 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:26 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30" returned: 0 in 4.470s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:26 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe031ff-1caa-4658-98fb-996f045cdb74]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:27 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:27 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:27 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.546s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:07:27 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Converted 1024.00 MB image at 229.04 MB/s Jul 31 11:07:27 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 is being set with open permissions: ugo+rw Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:27 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 Jul 31 11:07:27 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:27 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30" returned: 0 in 0.271s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-ca4f555c-cf65-4b98-811b-737a9702ee30" released by "_copy_volume_from_snapshot" :: held 6.225s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-a4f4cbef-cff7-41fe-8d87-c0485680a66e-ca4f555c-cf65-4b98-811b-737a9702ee30" released by "_create_volume_from_snapshot" :: held 6.262s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.278s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e901d80-63b5-4ea5-acd7-57057ec86e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4f555c-cf65-4b98-811b-737a9702ee30', 'volume_size': 1, 'snapshot_id': 'a4f4cbef-cff7-41fe-8d87-c0485680a66e'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3113c862-304c-402b-bbe0-f75beccbc35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:27 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Volume volume-ca4f555c-cf65-4b98-811b-737a9702ee30 (ca4f555c-cf65-4b98-811b-737a9702ee30): created successfully Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3113c862-304c-402b-bbe0-f75beccbc35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Flow 'volume_create_manager' (a409bd5b-431e-42eb-a4f6-6828146ccf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c198d336-ded0-4213-8adc-096da85ae987 tempest-SnapshotDependencyTests-2120186358 None] Created volume successfully. Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-a4f4cbef-cff7-41fe-8d87-c0485680a66e-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-a4f4cbef-cff7-41fe-8d87-c0485680a66e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-quobyte-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-quobyte-a4f4cbef-cff7-41fe-8d87-c0485680a66e" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-a4f4cbef-cff7-41fe-8d87-c0485680a66e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Deleting offline snapshot a4f4cbef-cff7-41fe-8d87-c0485680a66e of volume bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] snapshot_file for this snap is: volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd830a89-4f63-4d0c-a03a-ed59e9f2bf11]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:28 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e Jul 31 11:07:28 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:28 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e" returned: 0 in 0.392s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb558df8-bf91-48fb-aad0-236c03367243]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:28 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:28 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:29 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.436s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:29 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e Jul 31 11:07:29 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:29 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:29 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e Jul 31 11:07:29 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:29 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668.a4f4cbef-cff7-41fe-8d87-c0485680a66e" returned: 0 in 0.271s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-a4f4cbef-cff7-41fe-8d87-c0485680a66e" released by "_delete_snapshot" :: held 1.591s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" released by "delete_snapshot" :: held 1.615s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:29 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Created reservations ['4730eaae-0ff5-4bee-9b24-a0e8e200ddc4', '569afa14-b7b3-4aaf-8502-ade9b6174ca1', '424cee04-b97d-42b2-b9f8-bba63384164a', 'f34ceddd-1473-4b7f-b09b-92fe15a2811e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Delete snapshot completed successfully. Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ffe9d573-3813-409c-90da-c632b7f8b798 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-a4f4cbef-cff7-41fe-8d87-c0485680a66e-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-bf6d9ad2-085c-416f-a1c3-714ffbd2b668-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-bf6d9ad2-085c-416f-a1c3-714ffbd2b668-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-quobyte-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6b06b-c372-481f-8e23-fdf2ed7f932b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:30 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:30 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:31 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.535s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:31 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668 Jul 31 11:07:31 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:31 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-bf6d9ad2-085c-416f-a1c3-714ffbd2b668" released by "delete_volume" :: held 0.987s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Created reservations ['b014fc40-cf2f-4616-b4b7-74d0ed698bc3', 'f986db02-9cdc-4596-9f64-33f170246dcf', '74b4ec54-85d0-47c2-841f-1420bb8f1028', 'df1d91c0-fb0f-4274-960b-ca060eaea52b'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:31 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:07:31 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:32 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.320s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Deleted volume successfully. Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6f4becaf-801a-42ea-8a8f-4c5642758883 tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-bf6d9ad2-085c-416f-a1c3-714ffbd2b668-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-ca4f555c-cf65-4b98-811b-737a9702ee30-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-ca4f555c-cf65-4b98-811b-737a9702ee30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "cinder-quobyte-ca4f555c-cf65-4b98-811b-737a9702ee30" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-ca4f555c-cf65-4b98-811b-737a9702ee30" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ec1db7-f312-46dd-ba53-a05cde0ad79a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:32 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 Jul 31 11:07:32 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:33 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30" returned: 0 in 0.416s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:33 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30 Jul 31 11:07:33 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:33 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ca4f555c-cf65-4b98-811b-737a9702ee30" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-quobyte-ca4f555c-cf65-4b98-811b-737a9702ee30" released by "delete_volume" :: held 0.820s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Created reservations ['ae112b05-a447-4d7f-b1a4-5b535ffa6892', 'aafd3070-77f2-4c1f-ba28-729fc748f5d5', '421917e1-57de-4056-bf65-5951e364ebbd', '13214de4-73ab-4a2d-85ee-58dceb46692f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:33 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:07:33 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:34 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.297s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:34 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:34 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Deleted volume successfully. Jul 31 11:07:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3bbf1481-2fb8-49bb-8faf-c87835b4b3ab tempest-SnapshotDependencyTests-2120186358 None] Lock "cinder-ca4f555c-cf65-4b98-811b-737a9702ee30-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:07:43 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=4 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:07:44 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=24,cinder:SELECT=22,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:46 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:07:46 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:46 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.274s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:07:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Flow 'volume_create_manager' (9107c06d-5945-4554-8198-77b1b8aa0687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e733e2-14cb-40a1-a94b-38e4219ed2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e733e2-14cb-40a1-a94b-38e4219ed2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-197164467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5842bd-868b-407e-bee5-ced6b349b366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf93cc675b846409ac11e451861115d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:57Z,use_quota=True,user_id='871c684cd4204d9d8f1101d6dfeb29cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663a84cd-41aa-4e5e-8761-f80958b40ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663a84cd-41aa-4e5e-8761-f80958b40ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0d5353-38a8-4e19-83f1-6555c6a8aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0d5353-38a8-4e19-83f1-6555c6a8aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5842bd-868b-407e-bee5-ced6b349b366', 'volume_name': 'volume-0e5842bd-868b-407e-bee5-ced6b349b366', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c91af56-0398-4deb-b591-f302fbe3dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c91af56-0398-4deb-b591-f302fbe3dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de48ea4a-a0de-4beb-aae6-701aefb872f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Volume 0e5842bd-868b-407e-bee5-ced6b349b366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5842bd-868b-407e-bee5-ced6b349b366', 'volume_size': 1} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-197164467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5842bd-868b-407e-bee5-ced6b349b366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf93cc675b846409ac11e451861115d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:07:57Z,use_quota=True,user_id='871c684cd4204d9d8f1101d6dfeb29cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Creating volume 0e5842bd-868b-407e-bee5-ced6b349b366 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:07:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:07:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:56 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 1073741824 Jul 31 11:07:56 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:57 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 1073741824" returned: 0 in 0.422s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:57 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 Jul 31 11:07:57 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:57 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366" returned: 0 in 0.233s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de48ea4a-a0de-4beb-aae6-701aefb872f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5842bd-868b-407e-bee5-ced6b349b366', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2680854-8797-4ab3-add9-8f5980fe6b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:07:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Volume volume-0e5842bd-868b-407e-bee5-ced6b349b366 (0e5842bd-868b-407e-bee5-ced6b349b366): created successfully Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2680854-8797-4ab3-add9-8f5980fe6b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:07:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Flow 'volume_create_manager' (9107c06d-5945-4554-8198-77b1b8aa0687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:07:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-13769174-2f3e-4c03-8837-8a91bb75fb29 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Created volume successfully. Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c930d1-a1fd-4ec7-926f-e50e95915a60]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:07:58 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 Jul 31 11:07:58 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:07:58 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366" returned: 0 in 0.347s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.364s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:07:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-0e5842bd-868b-407e-bee5-ced6b349b366', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e936df8-edcc-4bea-80a0-2e8ef02b99f8', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:07:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-d137668c-183e-4534-be90-cd6f79d1fd02 req-4b154a1b-dcac-415c-b089-1dac69d22328 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] attachment_update completed successfully. Jul 31 11:08:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-4b3c33b3-e3ba-4025-a4b9-3eca3f836433 req-41384257-364d-47f4-ab49-032d244480ed tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Terminate volume connection completed successfully. Jul 31 11:08:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-4b3c33b3-e3ba-4025-a4b9-3eca3f836433 req-41384257-364d-47f4-ab49-032d244480ed tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Deleting attachment 7e936df8-edcc-4bea-80a0-2e8ef02b99f8. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:08:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Acquiring lock "cinder-0e5842bd-868b-407e-bee5-ced6b349b366-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "cinder-0e5842bd-868b-407e-bee5-ced6b349b366-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Acquiring lock "cinder-quobyte-0e5842bd-868b-407e-bee5-ced6b349b366" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:08:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "cinder-quobyte-0e5842bd-868b-407e-bee5-ced6b349b366" acquired by "delete_volume" :: waited 0.012s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:08:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edae5dc-39d3-431c-bd49-a90e1978d8e6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:08:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:02 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 Jul 31 11:08:02 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:03 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366" returned: 0 in 0.339s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:03 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366 Jul 31 11:08:03 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:03 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0e5842bd-868b-407e-bee5-ced6b349b366" returned: 0 in 0.232s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "cinder-quobyte-0e5842bd-868b-407e-bee5-ced6b349b366" released by "delete_volume" :: held 0.606s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Created reservations ['a7a71328-1d41-4445-a3dc-a9d8e113925d', '844988df-362e-429d-af4a-72326e95ae46', '683d9a5b-f3c3-4f24-9954-6c4836c66345', '0ef502f1-d922-46d6-9c91-56a60b3b27a2'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:03 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:08:03 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:03 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Deleted volume successfully. Jul 31 11:08:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6570802d-d77b-4fc9-ae70-5fc2d247be88 tempest-TestServerVolumeAttachScenarioOldVersion-2089213875 None] Lock "cinder-0e5842bd-868b-407e-bee5-ced6b349b366-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:08:13 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:08:13 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Flow 'volume_create_manager' (ad31ea42-7464-4341-944e-04255ff4e736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41165356-0ee7-41ae-9867-d817a587c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41165356-0ee7-41ae-9867-d817a587c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-372743320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea007c7-62a3-4857-b20a-ee7e2193aedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfeefd0f5e6e4bcda2373661fd97cfe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:38Z,use_quota=True,user_id='0b26d4156466470a9241ad14c9dc585c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c43fef0-429a-4e3c-88fc-9edc59b906dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c43fef0-429a-4e3c-88fc-9edc59b906dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16c90bb-405b-410b-87ad-dbddca8fb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16c90bb-405b-410b-87ad-dbddca8fb10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea007c7-62a3-4857-b20a-ee7e2193aedc', 'volume_name': 'volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65796e-e196-402b-bc4a-88018ad268bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65796e-e196-402b-bc4a-88018ad268bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745ae87c-f875-4292-b608-0d1d39d95691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Volume 0ea007c7-62a3-4857-b20a-ee7e2193aedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc', 'volume_size': 1} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-372743320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea007c7-62a3-4857-b20a-ee7e2193aedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfeefd0f5e6e4bcda2373661fd97cfe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:08:38Z,use_quota=True,user_id='0b26d4156466470a9241ad14c9dc585c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Creating volume 0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:08:37 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:08:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:37 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc 1073741824 Jul 31 11:08:37 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:38 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc 1073741824" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:38 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:08:38 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:38 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.267s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745ae87c-f875-4292-b608-0d1d39d95691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63efcda-b077-4fbc-a4d8-e289e4cf25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:08:38 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Volume volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc (0ea007c7-62a3-4857-b20a-ee7e2193aedc): created successfully Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63efcda-b077-4fbc-a4d8-e289e4cf25d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:08:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Flow 'volume_create_manager' (ad31ea42-7464-4341-944e-04255ff4e736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:08:38 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c8a14993-943e-47c1-ab1e-058596d7f78c tempest-TestStampPattern-972122204 None] Created volume successfully. Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:08:46 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:08:46 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:08:46 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.273s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:08:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:08:48 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:08:48 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fecf05-4f09-4c48-b0c4-1f8eb3526af8]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:07 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:09:07 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:07 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.372s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.390s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f75f7c8-54a0-493e-bd38-a59164e956e0', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:09:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-d4bba592-5439-4931-b3f6-c098fc6e09db req-3bfc49db-e89b-4f40-9753-38734de0169f tempest-TestStampPattern-972122204 None] attachment_update completed successfully. Jul 31 11:09:12 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-21bc7975-1609-46c4-95b6-420c5c5a4435 req-c090d07f-9c54-48fd-8a6f-cfceb7144b8a tempest-TestStampPattern-972122204 None] Terminate volume connection completed successfully. Jul 31 11:09:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-21bc7975-1609-46c4-95b6-420c5c5a4435 req-c090d07f-9c54-48fd-8a6f-cfceb7144b8a tempest-TestStampPattern-972122204 None] Deleting attachment 6f75f7c8-54a0-493e-bd38-a59164e956e0. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Creating offline snapshot ec1a7149-11a4-4076-98dc-a90615f0b185 of volume 0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc7cdde-008f-4934-a24d-cfc2c62ab33d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:13 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:09:13 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:13 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:13 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 1G Jul 31 11:09:13 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:14 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 1G" returned: 0 in 0.377s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 Jul 31 11:09:14 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:14 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185" returned: 0 in 0.283s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 is being set with open permissions: ugo+rw Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 Jul 31 11:09:14 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:14 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185" returned: 0 in 0.231s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info Jul 31 11:09:14 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:14 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info" returned: 0 in 0.239s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:14 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info is being set with open permissions: ugo+rw Jul 31 11:09:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:14 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info Jul 31 11:09:14 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:15 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.info" returned: 0 in 0.236s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:15 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a5e6ed28-5728-47b2-9695-36edc47105c7 tempest-TestStampPattern-972122204 None] Create snapshot completed successfully Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Flow 'volume_create_manager' (22ecb04a-8846-44d8-90d4-38c64a5dedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a720df-37b1-42c0-98a3-da3483d2c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a720df-37b1-42c0-98a3-da3483d2c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1984438610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416c0dd7-9aa6-489d-91b3-bd44710313b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfeefd0f5e6e4bcda2373661fd97cfe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec1a7149-11a4-4076-98dc-a90615f0b185,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:09:22Z,use_quota=True,user_id='0b26d4156466470a9241ad14c9dc585c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7579adef-bd6e-43c5-9948-b42d16f2dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7579adef-bd6e-43c5-9948-b42d16f2dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1676bce8-57a2-4b2b-a353-9e1a1b3b1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1676bce8-57a2-4b2b-a353-9e1a1b3b1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '416c0dd7-9aa6-489d-91b3-bd44710313b5', 'volume_name': 'volume-416c0dd7-9aa6-489d-91b3-bd44710313b5', 'volume_size': 1, 'snapshot_id': 'ec1a7149-11a4-4076-98dc-a90615f0b185'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5626d0bf-c445-4bf4-9bd5-e6d6e2d0b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5626d0bf-c445-4bf4-9bd5-e6d6e2d0b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecfda9f-a512-4b3a-a4ba-6a1d66815aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:22 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Volume 416c0dd7-9aa6-489d-91b3-bd44710313b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-416c0dd7-9aa6-489d-91b3-bd44710313b5', 'volume_size': 1, 'snapshot_id': 'ec1a7149-11a4-4076-98dc-a90615f0b185'} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-quobyte-ec1a7149-11a4-4076-98dc-a90615f0b185-416c0dd7-9aa6-489d-91b3-bd44710313b5" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-ec1a7149-11a4-4076-98dc-a90615f0b185-416c0dd7-9aa6-489d-91b3-bd44710313b5" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Creating volume 416c0dd7-9aa6-489d-91b3-bd44710313b5 from snapshot ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-quobyte-416c0dd7-9aa6-489d-91b3-bd44710313b5" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-416c0dd7-9aa6-489d-91b3-bd44710313b5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] snapshot: ec1a7149-11a4-4076-98dc-a90615f0b185, volume: 416c0dd7-9aa6-489d-91b3-bd44710313b5, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[60710261-34fa-4f00-b427-3ce900bccdd2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:22 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 Jul 31 11:09:22 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:22 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185" returned: 0 in 0.376s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96fd675-c184-4355-9d70-d8837175147f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:22 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:09:22 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:23 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.413s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:23 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:09:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:23 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 Jul 31 11:09:23 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:28 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5" returned: 0 in 5.238s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[050dfa1d-c819-4b59-9df3-7ea6fb1b3a2f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:28 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:09:28 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:29 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.627s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:09:29 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Converted 1024.00 MB image at 195.45 MB/s Jul 31 11:09:29 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 is being set with open permissions: ugo+rw Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:29 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 Jul 31 11:09:29 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:29 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5" returned: 0 in 0.300s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-416c0dd7-9aa6-489d-91b3-bd44710313b5" released by "_copy_volume_from_snapshot" :: held 7.070s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-ec1a7149-11a4-4076-98dc-a90615f0b185-416c0dd7-9aa6-489d-91b3-bd44710313b5" released by "_create_volume_from_snapshot" :: held 7.107s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.124s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecfda9f-a512-4b3a-a4ba-6a1d66815aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416c0dd7-9aa6-489d-91b3-bd44710313b5', 'volume_size': 1, 'snapshot_id': 'ec1a7149-11a4-4076-98dc-a90615f0b185'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03868106-f95d-441e-8a50-24820afce8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:09:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Volume volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 (416c0dd7-9aa6-489d-91b3-bd44710313b5): created successfully Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03868106-f95d-441e-8a50-24820afce8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:09:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Flow 'volume_create_manager' (22ecb04a-8846-44d8-90d4-38c64a5dedda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:09:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-377016ba-56eb-4c25-a1a5-f94379e89877 tempest-TestStampPattern-972122204 None] Created volume successfully. Jul 31 11:09:39 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=7,cinder:SELECT=15 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:09:39 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=2 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:46 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:09:46 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:46 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.232s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:09:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83cc24-8f26-4739-a5f4-8ed86b1a37d2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:09:58 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 Jul 31 11:09:58 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:09:58 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5" returned: 0 in 0.345s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.362s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:09:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3', 'name': 'volume-416c0dd7-9aa6-489d-91b3-bd44710313b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b423e92-abcb-4f4e-9b35-555188abecf2', 'enforce_multipath': True} {{(pid=88837) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 31 11:09:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-7ed97f35-aaef-48b9-bd72-a209ad90de25 req-69a37487-a56b-4cf0-9b75-20c69746f0d7 tempest-TestStampPattern-972122204 None] attachment_update completed successfully. Jul 31 11:10:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [req-2428e074-8b11-49a4-b8ac-574c77092ec0 req-a5aaae78-46c9-4828-9329-1f95c5fc097b tempest-TestStampPattern-972122204 None] Terminate volume connection completed successfully. Jul 31 11:10:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [req-2428e074-8b11-49a4-b8ac-574c77092ec0 req-a5aaae78-46c9-4828-9329-1f95c5fc097b tempest-TestStampPattern-972122204 None] Deleting attachment 2b423e92-abcb-4f4e-9b35-555188abecf2. {{(pid=88837) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 31 11:10:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-416c0dd7-9aa6-489d-91b3-bd44710313b5-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Lock "cinder-416c0dd7-9aa6-489d-91b3-bd44710313b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-quobyte-416c0dd7-9aa6-489d-91b3-bd44710313b5" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-416c0dd7-9aa6-489d-91b3-bd44710313b5" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd0914-2989-4325-91df-7d95000c7119]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:06 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 Jul 31 11:10:06 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:06 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5" returned: 0 in 0.343s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:06 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5 Jul 31 11:10:06 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:06 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-416c0dd7-9aa6-489d-91b3-bd44710313b5" returned: 0 in 0.237s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-416c0dd7-9aa6-489d-91b3-bd44710313b5" released by "delete_volume" :: held 0.616s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Created reservations ['f81c9d92-df9e-47be-b454-a4c9c9fb2235', 'e5b34344-4f19-4de9-bddc-5cc46f27d502', '4eb79f07-bd86-435d-81f4-1a645fb25973', 'b1d37205-b310-46ea-8717-9de1003d732f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:06 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:06 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:07 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.248s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Deleted volume successfully. Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6357ead2-87a5-405f-90e8-1d805189d9e4 tempest-TestStampPattern-972122204 None] Lock "cinder-416c0dd7-9aa6-489d-91b3-bd44710313b5-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-ec1a7149-11a4-4076-98dc-a90615f0b185-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Lock "cinder-ec1a7149-11a4-4076-98dc-a90615f0b185-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-quobyte-0ea007c7-62a3-4857-b20a-ee7e2193aedc" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-0ea007c7-62a3-4857-b20a-ee7e2193aedc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-quobyte-ec1a7149-11a4-4076-98dc-a90615f0b185" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-ec1a7149-11a4-4076-98dc-a90615f0b185" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Deleting offline snapshot ec1a7149-11a4-4076-98dc-a90615f0b185 of volume 0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] snapshot_file for this snap is: volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad81c0f-859f-4697-bb74-128a1a79ab99]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:07 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 Jul 31 11:10:07 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:07 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185" returned: 0 in 0.349s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb1c06-75ce-4f40-a5a3-ef809083d55b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:07 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:10:07 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:08 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.340s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:08 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 Jul 31 11:10:08 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:08 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185" returned: 0 in 0.321s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:08 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185 Jul 31 11:10:08 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:08 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc.ec1a7149-11a4-4076-98dc-a90615f0b185" returned: 0 in 0.233s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-ec1a7149-11a4-4076-98dc-a90615f0b185" released by "_delete_snapshot" :: held 1.334s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-0ea007c7-62a3-4857-b20a-ee7e2193aedc" released by "delete_snapshot" :: held 1.355s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Created reservations ['d1180e62-f70c-432e-8913-fadb51dab526', '46e25604-ac79-47ca-81e5-16680f2c582c', '5b198e00-2d0a-45ad-a970-57fe33b0bb33', '54954935-c71d-499e-baf6-133e7bb0bbbf'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Delete snapshot completed successfully. Jul 31 11:10:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2b7e9565-c4b5-4723-894e-ebc7100cb328 tempest-TestStampPattern-972122204 None] Lock "cinder-ec1a7149-11a4-4076-98dc-a90615f0b185-delete_snapshot" released by "delete_snapshot" :: held 1.479s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-0ea007c7-62a3-4857-b20a-ee7e2193aedc-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Lock "cinder-0ea007c7-62a3-4857-b20a-ee7e2193aedc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Acquiring lock "cinder-quobyte-0ea007c7-62a3-4857-b20a-ee7e2193aedc" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-0ea007c7-62a3-4857-b20a-ee7e2193aedc" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6526cd3e-b50d-4468-bfad-1d9e3ea5f6c0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:13 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:10:13 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:13 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.357s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:13 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc Jul 31 11:10:13 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:13 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-0ea007c7-62a3-4857-b20a-ee7e2193aedc" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Lock "cinder-quobyte-0ea007c7-62a3-4857-b20a-ee7e2193aedc" released by "delete_volume" :: held 0.646s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Created reservations ['95f64342-33df-4be6-9318-08e1b380c15a', '80d8179c-9bc2-4005-82d6-d5aed20b4094', '18a9d8c0-28d2-41c3-b49e-1ac40d7316a3', '97c0cc8c-4c18-46d8-a981-2142b5911fde'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:13 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:13 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:14 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.232s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:14 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Deleted volume successfully. Jul 31 11:10:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bdefdbd0-b05f-4477-88be-d2bed915206a tempest-TestStampPattern-972122204 None] Lock "cinder-0ea007c7-62a3-4857-b20a-ee7e2193aedc-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (9e5fad39-aac8-4957-a16d-b71a08a029e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8647b972-6d4f-42c6-a4b6-de0939f4659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8647b972-6d4f-42c6-a4b6-de0939f4659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757855655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272bc301-f259-4537-b8e5-1735b82fab4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:24Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff586e93-f799-4dcf-b268-9e6175819721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff586e93-f799-4dcf-b268-9e6175819721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd04456-da26-420c-aec8-247596aeba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd04456-da26-420c-aec8-247596aeba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272bc301-f259-4537-b8e5-1735b82fab4f', 'volume_name': 'volume-272bc301-f259-4537-b8e5-1735b82fab4f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3deb6a-b2f9-44c8-8b05-b4cb0ab0da60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3deb6a-b2f9-44c8-8b05-b4cb0ab0da60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c9fd85-df2e-4325-bec2-be796fa52de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:23 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume 272bc301-f259-4537-b8e5-1735b82fab4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272bc301-f259-4537-b8e5-1735b82fab4f', 'volume_size': 1} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757855655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272bc301-f259-4537-b8e5-1735b82fab4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:24Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Creating volume 272bc301-f259-4537-b8e5-1735b82fab4f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:23 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:23 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f 1073741824 Jul 31 11:10:23 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:24 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f 1073741824" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:24 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f Jul 31 11:10:24 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:24 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f" returned: 0 in 0.249s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c9fd85-df2e-4325-bec2-be796fa52de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272bc301-f259-4537-b8e5-1735b82fab4f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b812583e-d0a3-439f-bcbc-18ed87e613d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:24 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume volume-272bc301-f259-4537-b8e5-1735b82fab4f (272bc301-f259-4537-b8e5-1735b82fab4f): created successfully Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b812583e-d0a3-439f-bcbc-18ed87e613d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:24 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (9e5fad39-aac8-4957-a16d-b71a08a029e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3e321e5f-4bec-4930-bff9-793b0acf9d3f tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created volume successfully. Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (d2ed4a2d-9077-445b-b792-5d2c61b9a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6866736-a9cc-492e-aeaa-b7e5b1b849b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6866736-a9cc-492e-aeaa-b7e5b1b849b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1118082628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc7282-fc08-4717-92e6-cfdf7edc89ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:25Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0b58bd-71be-4ac5-aeff-9460ce37acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0b58bd-71be-4ac5-aeff-9460ce37acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b66367-94dd-4de2-be98-1e7702de0a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b66367-94dd-4de2-be98-1e7702de0a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddc7282-fc08-4717-92e6-cfdf7edc89ae', 'volume_name': 'volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2544cb82-35ab-4b2a-b04d-8cde76bb96ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2544cb82-35ab-4b2a-b04d-8cde76bb96ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef09bd80-9c0e-4d52-a20e-fa4207df012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume 6ddc7282-fc08-4717-92e6-cfdf7edc89ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae', 'volume_size': 1} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1118082628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc7282-fc08-4717-92e6-cfdf7edc89ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:25Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Creating volume 6ddc7282-fc08-4717-92e6-cfdf7edc89ae {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:25 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:25 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae 1073741824 Jul 31 11:10:25 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (4d143d4a-8b8d-407e-9fe3-af8960e2d08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f078f3f9-30f0-4c12-bd25-bc371e075a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f078f3f9-30f0-4c12-bd25-bc371e075a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991254140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74965f1-9aee-40ee-b4a3-234c0869570f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:25Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6d253c-b446-421b-910f-ad0c7ca951db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6d253c-b446-421b-910f-ad0c7ca951db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc4f6cf-79f4-42fa-b4dd-95244c2a7c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc4f6cf-79f4-42fa-b4dd-95244c2a7c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74965f1-9aee-40ee-b4a3-234c0869570f', 'volume_name': 'volume-b74965f1-9aee-40ee-b4a3-234c0869570f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48214378-4ff2-4659-b4bd-1d7f58896cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48214378-4ff2-4659-b4bd-1d7f58896cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcdba28-e782-4ddc-a6d9-6ea9706a1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume b74965f1-9aee-40ee-b4a3-234c0869570f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74965f1-9aee-40ee-b4a3-234c0869570f', 'volume_size': 1} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:25 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae 1073741824" returned: 0 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:25 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae Jul 31 11:10:25 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (231d15a3-364e-42d9-9bd2-458b6a11001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63617e34-6ecd-4ad7-ae5b-39841fc00f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63617e34-6ecd-4ad7-ae5b-39841fc00f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126806538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91daf48a-568b-4d06-bff5-17d7b1a0573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:26Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2380f1-1419-488a-9a11-ea8585f38ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2380f1-1419-488a-9a11-ea8585f38ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16b3d17-b1fd-4ed2-9838-23a45e4293de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16b3d17-b1fd-4ed2-9838-23a45e4293de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91daf48a-568b-4d06-bff5-17d7b1a0573b', 'volume_name': 'volume-91daf48a-568b-4d06-bff5-17d7b1a0573b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300989ac-2c0c-48fa-be73-e1427fed6631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300989ac-2c0c-48fa-be73-e1427fed6631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c643c5f-5ab4-42a3-8c01-318be157208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume 91daf48a-568b-4d06-bff5-17d7b1a0573b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91daf48a-568b-4d06-bff5-17d7b1a0573b', 'volume_size': 1} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae" returned: 0 in 0.274s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-991254140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74965f1-9aee-40ee-b4a3-234c0869570f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:25Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Creating volume b74965f1-9aee-40ee-b4a3-234c0869570f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef09bd80-9c0e-4d52-a20e-fa4207df012b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8bb613-2fcb-45ab-babf-915fe801c607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f 1073741824 Jul 31 11:10:26 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae (6ddc7282-fc08-4717-92e6-cfdf7edc89ae): created successfully Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8bb613-2fcb-45ab-babf-915fe801c607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (d2ed4a2d-9077-445b-b792-5d2c61b9a030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8f350642-059e-4f40-a0db-6b6099526d01 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created volume successfully. Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (cfafbc1c-0bfd-462b-bbf1-33c426d084ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdc0011-31be-401f-a7cc-2e82f40de1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdc0011-31be-401f-a7cc-2e82f40de1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-98495402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc788f54-ef87-401c-8ea2-a0e44c0f280e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:26Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e78223-a397-4be7-82f9-5f14bb65f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e78223-a397-4be7-82f9-5f14bb65f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53d6b2b-f7b2-49b4-8d20-13ac0584b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53d6b2b-f7b2-49b4-8d20-13ac0584b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc788f54-ef87-401c-8ea2-a0e44c0f280e', 'volume_name': 'volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198c5183-d059-4dc8-8be3-aed069e61f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198c5183-d059-4dc8-8be3-aed069e61f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458344df-2f2d-48f5-97d9-8e77c3ea14f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume cc788f54-ef87-401c-8ea2-a0e44c0f280e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e', 'volume_size': 1} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f 1073741824" returned: 0 in 0.513s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:26 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f Jul 31 11:10:26 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (95a7c174-edf2-4030-9089-9b823ec697ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03e09f3-35f0-4c13-9e60-8d659540252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03e09f3-35f0-4c13-9e60-8d659540252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075937936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b22465-da45-4cfc-9118-16ee2290a6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:27Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5847e74-6ef8-42f5-b39c-d91f9e5d7dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5847e74-6ef8-42f5-b39c-d91f9e5d7dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a543ade-b730-4c5e-a8f6-617bc0800329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a543ade-b730-4c5e-a8f6-617bc0800329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b22465-da45-4cfc-9118-16ee2290a6d2', 'volume_name': 'volume-92b22465-da45-4cfc-9118-16ee2290a6d2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dfb85a-1048-44d7-aca4-b5a6446a6331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91dfb85a-1048-44d7-aca4-b5a6446a6331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a52280-f413-4d08-9a02-7f8562f0d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume 92b22465-da45-4cfc-9118-16ee2290a6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b22465-da45-4cfc-9118-16ee2290a6d2', 'volume_size': 1} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f" returned: 0 in 0.242s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1126806538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91daf48a-568b-4d06-bff5-17d7b1a0573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:26Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Creating volume 91daf48a-568b-4d06-bff5-17d7b1a0573b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcdba28-e782-4ddc-a6d9-6ea9706a1c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74965f1-9aee-40ee-b4a3-234c0869570f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b 1073741824 Jul 31 11:10:26 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164541e8-3b94-4cc0-ade1-d0063ce28c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume volume-b74965f1-9aee-40ee-b4a3-234c0869570f (b74965f1-9aee-40ee-b4a3-234c0869570f): created successfully Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164541e8-3b94-4cc0-ade1-d0063ce28c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:26 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (4d143d4a-8b8d-407e-9fe3-af8960e2d08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bb5cda52-0ecb-4471-aedb-eb0701e7f604 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created volume successfully. Jul 31 11:10:27 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b 1073741824" returned: 0 in 0.409s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:27 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b Jul 31 11:10:27 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:27 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b" returned: 0 in 0.229s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-98495402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc788f54-ef87-401c-8ea2-a0e44c0f280e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:26Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Creating volume cc788f54-ef87-401c-8ea2-a0e44c0f280e {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:27 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:27 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e 1073741824 Jul 31 11:10:27 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c643c5f-5ab4-42a3-8c01-318be157208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91daf48a-568b-4d06-bff5-17d7b1a0573b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9e8d79-eae4-4f19-9c5d-910324f1e0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:27 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume volume-91daf48a-568b-4d06-bff5-17d7b1a0573b (91daf48a-568b-4d06-bff5-17d7b1a0573b): created successfully Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9e8d79-eae4-4f19-9c5d-910324f1e0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (231d15a3-364e-42d9-9bd2-458b6a11001b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e9e6fdb1-7623-46b1-b724-21bfac980723 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created volume successfully. Jul 31 11:10:27 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e 1073741824" returned: 0 in 0.427s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:28 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e Jul 31 11:10:28 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075937936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b22465-da45-4cfc-9118-16ee2290a6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5ab26e1fd8a49e2bf16de3f07b3c02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:27Z,use_quota=True,user_id='90082d20ed3141bb94808070594c5530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Creating volume 92b22465-da45-4cfc-9118-16ee2290a6d2 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:28 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458344df-2f2d-48f5-97d9-8e77c3ea14f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:28 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 1073741824 Jul 31 11:10:28 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d40382d-3c30-4eb9-91e7-8758c09dde56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e (cc788f54-ef87-401c-8ea2-a0e44c0f280e): created successfully Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d40382d-3c30-4eb9-91e7-8758c09dde56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (cfafbc1c-0bfd-462b-bbf1-33c426d084ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-89cb3ea9-13ce-4323-b220-f34e7fc26383 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created volume successfully. Jul 31 11:10:28 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 1073741824" returned: 0 in 0.402s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:28 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 Jul 31 11:10:28 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:28 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2" returned: 0 in 0.241s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a52280-f413-4d08-9a02-7f8562f0d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b22465-da45-4cfc-9118-16ee2290a6d2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30b709a-9de4-4161-96c9-ad0d06b7fbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Volume volume-92b22465-da45-4cfc-9118-16ee2290a6d2 (92b22465-da45-4cfc-9118-16ee2290a6d2): created successfully Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30b709a-9de4-4161-96c9-ad0d06b7fbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Flow 'volume_create_manager' (95a7c174-edf2-4030-9089-9b823ec697ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f80a4fe8-f9b4-4b5a-a9ac-94efdbf8554b tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created volume successfully. Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-92b22465-da45-4cfc-9118-16ee2290a6d2-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-92b22465-da45-4cfc-9118-16ee2290a6d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-quobyte-92b22465-da45-4cfc-9118-16ee2290a6d2" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-92b22465-da45-4cfc-9118-16ee2290a6d2" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e570d8fe-db38-4691-809a-cbf05aed74e6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:30 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 Jul 31 11:10:30 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:30 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2" returned: 0 in 0.344s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:30 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2 Jul 31 11:10:30 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:30 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-92b22465-da45-4cfc-9118-16ee2290a6d2" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-92b22465-da45-4cfc-9118-16ee2290a6d2" released by "delete_volume" :: held 0.623s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created reservations ['98e8b3d6-10b5-4205-81cb-435cf65877af', '7975aefc-f25d-420f-ada1-5bf6dfac58fe', 'ef197e1f-e5ff-485f-8b69-b9ebd7cbd74f', '72b47375-0fe6-41d6-87e7-cf0bacf755e4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:31 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:31 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:31 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:31 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Deleted volume successfully. Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0a05090a-3c35-45c9-9caf-1cb1a73768f1 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-92b22465-da45-4cfc-9118-16ee2290a6d2-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-cc788f54-ef87-401c-8ea2-a0e44c0f280e-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-cc788f54-ef87-401c-8ea2-a0e44c0f280e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-quobyte-cc788f54-ef87-401c-8ea2-a0e44c0f280e" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-cc788f54-ef87-401c-8ea2-a0e44c0f280e" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c70b10-2402-4f4a-a140-49c074611253]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:31 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e Jul 31 11:10:31 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:31 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e" returned: 0 in 0.355s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:31 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e Jul 31 11:10:31 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:32 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-cc788f54-ef87-401c-8ea2-a0e44c0f280e" returned: 0 in 0.240s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-cc788f54-ef87-401c-8ea2-a0e44c0f280e" released by "delete_volume" :: held 0.634s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created reservations ['fc06cfa3-7f42-4c41-ae89-39af71a5dac1', '9f73f75c-80d0-44e4-8dcd-619e0faaa378', 'cd075cd9-4ec2-451e-999e-4ab49b4a7d08', '4c19851c-e21a-4a04-afe3-3ca1c7a0071f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:32 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:32 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:32 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.248s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Deleted volume successfully. Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19a5f265-6ec3-469e-8cb0-9db0a662482c tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-cc788f54-ef87-401c-8ea2-a0e44c0f280e-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-91daf48a-568b-4d06-bff5-17d7b1a0573b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-91daf48a-568b-4d06-bff5-17d7b1a0573b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-quobyte-91daf48a-568b-4d06-bff5-17d7b1a0573b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-91daf48a-568b-4d06-bff5-17d7b1a0573b" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[09318130-a7ed-4449-8cf4-b1d01ea4dfde]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:32 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b Jul 31 11:10:32 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:33 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:33 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b Jul 31 11:10:33 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:33 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-91daf48a-568b-4d06-bff5-17d7b1a0573b" returned: 0 in 0.246s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-91daf48a-568b-4d06-bff5-17d7b1a0573b" released by "delete_volume" :: held 0.619s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created reservations ['a7be5bf6-3cd4-4ac9-b526-aac77742546e', '7716ed9a-93cf-4319-a2cb-d565daa72dc4', '235e2b07-360d-4c90-b7e6-b80fd7a295db', 'ee9c5add-692a-4a96-a03a-c35ac5f059eb'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:33 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:33 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:33 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.249s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:33 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Deleted volume successfully. Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b22d9c25-52d7-42af-8214-3b8e4706eeee tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-91daf48a-568b-4d06-bff5-17d7b1a0573b-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-b74965f1-9aee-40ee-b4a3-234c0869570f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-b74965f1-9aee-40ee-b4a3-234c0869570f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-quobyte-b74965f1-9aee-40ee-b4a3-234c0869570f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-b74965f1-9aee-40ee-b4a3-234c0869570f" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[44201036-a2bf-4cba-aa15-7ff4e57174ed]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:33 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f Jul 31 11:10:33 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:34 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f" returned: 0 in 0.357s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:34 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f Jul 31 11:10:34 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:34 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b74965f1-9aee-40ee-b4a3-234c0869570f" returned: 0 in 0.249s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-b74965f1-9aee-40ee-b4a3-234c0869570f" released by "delete_volume" :: held 0.644s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created reservations ['2e5a5039-9bf4-41e3-a699-c99c5def47ad', '54d219e6-d6de-4001-8fd6-1f29f0b2f62e', '2e443f8b-a922-4bb6-ba92-53754f1a2faa', 'd82e70d2-3913-4b32-bdff-adc7e236521f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:34 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:34 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:34 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.233s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:34 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Deleted volume successfully. Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6864c59f-f1b6-4034-ae11-cabbcd71f813 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-b74965f1-9aee-40ee-b4a3-234c0869570f-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-6ddc7282-fc08-4717-92e6-cfdf7edc89ae-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-6ddc7282-fc08-4717-92e6-cfdf7edc89ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-quobyte-6ddc7282-fc08-4717-92e6-cfdf7edc89ae" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-6ddc7282-fc08-4717-92e6-cfdf7edc89ae" acquired by "delete_volume" :: waited 0.013s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:34 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2265c3de-86b9-4665-9618-449572f70435]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae Jul 31 11:10:35 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:35 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae" returned: 0 in 0.381s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae Jul 31 11:10:35 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:35 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6ddc7282-fc08-4717-92e6-cfdf7edc89ae" returned: 0 in 0.259s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-6ddc7282-fc08-4717-92e6-cfdf7edc89ae" released by "delete_volume" :: held 0.676s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created reservations ['2e329904-9a44-4737-be61-23609c04b43f', 'a76fcef2-7db0-465b-9521-8d824efdf12e', '6cd54597-44d9-4323-8960-da5b55479457', '0e612f3d-b1ab-461b-8979-773a4ee8817f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:35 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:35 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:36 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.251s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Deleted volume successfully. Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9c335e65-8933-4f64-bdf1-2dd40b9ea5a6 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-6ddc7282-fc08-4717-92e6-cfdf7edc89ae-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-272bc301-f259-4537-b8e5-1735b82fab4f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-272bc301-f259-4537-b8e5-1735b82fab4f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "cinder-quobyte-272bc301-f259-4537-b8e5-1735b82fab4f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-272bc301-f259-4537-b8e5-1735b82fab4f" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d0001-75c3-44d2-a615-00581aefce6b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:36 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f Jul 31 11:10:36 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:36 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f" returned: 0 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:36 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f Jul 31 11:10:36 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:36 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-272bc301-f259-4537-b8e5-1735b82fab4f" returned: 0 in 0.250s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-quobyte-272bc301-f259-4537-b8e5-1735b82fab4f" released by "delete_volume" :: held 0.651s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Created reservations ['611c5249-7aac-4425-85ca-eb90f6af6127', '3db713b1-68bf-4b53-ab07-a75482e47266', '627e1ee8-eabe-45e3-ade7-d443b56e2911', 'c718cc62-c556-443c-83eb-a3be50dd5044'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:36 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:36 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:37 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.245s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:37 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Deleted volume successfully. Jul 31 11:10:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-91005faf-a994-4365-ae86-87cdec4a5d08 tempest-CreateVolumesFromSourceVolumeTest-1636378205 None] Lock "cinder-272bc301-f259-4537-b8e5-1735b82fab4f-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:39 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Flow 'volume_create_manager' (ba7a77d6-2eac-4dd2-82cd-a450bfef8267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a425184-8204-4c5d-80b1-b436584ba590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a425184-8204-4c5d-80b1-b436584ba590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1f01e9-b89d-4192-af56-3ed78fe9ef6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d08165bc6d4d0f88f5e15a78775afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:40Z,use_quota=True,user_id='ce8bcc8dd396408b9193a9ff6bd55faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55ff288-a4a3-42f4-ada9-e0a1b66f0b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e55ff288-a4a3-42f4-ada9-e0a1b66f0b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c7cd90-535d-47ab-aa17-2e2081f990cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c7cd90-535d-47ab-aa17-2e2081f990cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1f01e9-b89d-4192-af56-3ed78fe9ef6e', 'volume_name': 'volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b439a08-c824-48ec-8bb6-95d1606a6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b439a08-c824-48ec-8bb6-95d1606a6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f26321-02bd-4fdb-b39b-6f987156179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Volume ed1f01e9-b89d-4192-af56-3ed78fe9ef6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e', 'volume_size': 1} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1f01e9-b89d-4192-af56-3ed78fe9ef6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d08165bc6d4d0f88f5e15a78775afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:40Z,use_quota=True,user_id='ce8bcc8dd396408b9193a9ff6bd55faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Creating volume ed1f01e9-b89d-4192-af56-3ed78fe9ef6e {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:40 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:40 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e 1073741824 Jul 31 11:10:40 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:40 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e 1073741824" returned: 0 in 0.394s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:40 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e Jul 31 11:10:40 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:40 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f26321-02bd-4fdb-b39b-6f987156179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50906b7d-7754-4f56-8f07-e59160de978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Volume volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e (ed1f01e9-b89d-4192-af56-3ed78fe9ef6e): created successfully Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50906b7d-7754-4f56-8f07-e59160de978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Flow 'volume_create_manager' (ba7a77d6-2eac-4dd2-82cd-a450bfef8267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:40 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b61d3749-0382-456f-b343-4ddd670d7d91 tempest-CinderUnicodeTest-500606102 None] Created volume successfully. Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Flow 'volume_create_manager' (312c85dd-6392-41de-bd2a-329ad75f4108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7a8b95-66cb-4879-81e7-9ac4976a6141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7a8b95-66cb-4879-81e7-9ac4976a6141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-980787154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d7e6c1-a3af-403a-b6a1-8c71115dc352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d08165bc6d4d0f88f5e15a78775afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:41Z,use_quota=True,user_id='ce8bcc8dd396408b9193a9ff6bd55faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f258df4d-a3db-46ed-a9bc-cf663e5cc5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f258df4d-a3db-46ed-a9bc-cf663e5cc5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9044750-6801-4c5a-ba2f-c5d797168f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9044750-6801-4c5a-ba2f-c5d797168f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d7e6c1-a3af-403a-b6a1-8c71115dc352', 'volume_name': 'volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d0962d-9e20-447e-b941-0fccd9a71b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d0962d-9e20-447e-b941-0fccd9a71b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa1e1bd-af92-4ff0-8eed-00ccd9ee1d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:41 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Volume f9d7e6c1-a3af-403a-b6a1-8c71115dc352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352', 'volume_size': 1} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:10:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-980787154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d7e6c1-a3af-403a-b6a1-8c71115dc352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d08165bc6d4d0f88f5e15a78775afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:10:41Z,use_quota=True,user_id='ce8bcc8dd396408b9193a9ff6bd55faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Creating volume f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:10:41 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:41 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 1073741824 Jul 31 11:10:41 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:41 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 1073741824" returned: 0 in 0.399s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:41 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 Jul 31 11:10:41 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:42 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" returned: 0 in 0.237s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa1e1bd-af92-4ff0-8eed-00ccd9ee1d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d922ec58-7a8b-4104-80a1-45cd369ad3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:10:42 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Volume volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 (f9d7e6c1-a3af-403a-b6a1-8c71115dc352): created successfully Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d922ec58-7a8b-4104-80a1-45cd369ad3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Flow 'volume_create_manager' (312c85dd-6392-41de-bd2a-329ad75f4108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:10:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5a6f361e-8a59-4ba4-98ce-5f7922839ce5 tempest-CinderUnicodeTest-500606102 None] Created volume successfully. Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Creating offline snapshot 80909851-0832-4e40-a326-7ac48121db39 of volume f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[630eaf2e-0bbb-4c5f-8028-7f7366221721]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:42 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 Jul 31 11:10:42 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:43 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 1G Jul 31 11:10:43 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 1G" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:43 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 Jul 31 11:10:43 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39" returned: 0 in 0.263s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 is being set with open permissions: ugo+rw Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:43 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 Jul 31 11:10:43 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:43 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39" returned: 0 in 0.226s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:43 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info Jul 31 11:10:43 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:44 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:44 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info is being set with open permissions: ugo+rw Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:44 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info Jul 31 11:10:44 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:44 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.info" returned: 0 in 0.230s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.733s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0bddd152-3f18-41ff-9ed8-b994c8dfeee0 tempest-CinderUnicodeTest-500606102 None] Create snapshot completed successfully Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-80909851-0832-4e40-a326-7ac48121db39-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-80909851-0832-4e40-a326-7ac48121db39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-quobyte-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-quobyte-80909851-0832-4e40-a326-7ac48121db39" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-80909851-0832-4e40-a326-7ac48121db39" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Deleting offline snapshot 80909851-0832-4e40-a326-7ac48121db39 of volume f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] snapshot_file for this snap is: volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba0bec-6029-465e-baa4-4fdbce5b28ad]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:44 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 Jul 31 11:10:44 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:45 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39" returned: 0 in 0.359s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc9c36-c150-40ce-90ee-9dc242c570f1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:45 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 Jul 31 11:10:45 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:45 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" returned: 0 in 0.345s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:45 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 Jul 31 11:10:45 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:45 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39" returned: 0 in 0.345s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:45 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39 Jul 31 11:10:45 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:46 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352.80909851-0832-4e40-a326-7ac48121db39" returned: 0 in 0.245s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-80909851-0832-4e40-a326-7ac48121db39" released by "_delete_snapshot" :: held 1.405s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" released by "delete_snapshot" :: held 1.429s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Created reservations ['4beb32b7-4f95-41c0-9375-915610f15907', 'a92518e1-a49d-4c3c-89df-e984fbeef68b', 'da97a1d2-c8ff-41f2-b8c6-21e8bb9373a9', '6aec06c4-00b5-48fc-bcbf-13241791d52e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:46 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Delete snapshot completed successfully. Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-0aad2bd0-aa69-456b-9e52-f01bcba5dfa3 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-80909851-0832-4e40-a326-7ac48121db39-delete_snapshot" released by "delete_snapshot" :: held 1.568s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:46 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:46 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:46 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.227s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-f9d7e6c1-a3af-403a-b6a1-8c71115dc352-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-f9d7e6c1-a3af-403a-b6a1-8c71115dc352-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-quobyte-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" acquired by "delete_volume" :: waited 0.013s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eef305-b013-47f7-a3a8-4177c3a692ec]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:47 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 Jul 31 11:10:47 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:47 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" returned: 0 in 0.334s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:47 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352 Jul 31 11:10:47 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:47 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" returned: 0 in 0.236s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-f9d7e6c1-a3af-403a-b6a1-8c71115dc352" released by "delete_volume" :: held 0.626s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Created reservations ['3eb6fcc6-64f1-4183-a92a-83f61211848d', 'ac403a82-ae92-4c96-96c4-c7062d397e7d', '50ed1231-0bd5-4cd8-afa7-f92e6624e4cb', 'c88c8dc9-3815-450d-aa5e-496577c5aaab'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:47 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:47 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:47 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.229s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Deleted volume successfully. Jul 31 11:10:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0ac356f-f7ec-4bd0-9d77-f6ccbf5e8d57 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-f9d7e6c1-a3af-403a-b6a1-8c71115dc352-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "cinder-quobyte-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea99f998-ec75-410a-b1dc-0d407a031f69]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:48 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e Jul 31 11:10:48 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:48 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e" returned: 0 in 0.342s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:48 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e Jul 31 11:10:48 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:48 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e" returned: 0 in 0.231s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-quobyte-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e" released by "delete_volume" :: held 0.607s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Created reservations ['b783b8f4-6475-467c-b00c-c2348621e22f', '1e0d0622-9190-4c9f-9097-10f19566a45e', '7ffa73cc-d351-4267-86d6-0cfcf47f50d3', '8bfd89a3-5371-42d2-af92-f418968d6b1c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:10:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:10:48 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:10:48 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:10:49 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 31 11:10:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.239s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:10:49 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:10:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Deleted volume successfully. Jul 31 11:10:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c9b88ecc-0282-43f1-b05a-ed3ab3093b66 tempest-CinderUnicodeTest-500606102 None] Lock "cinder-ed1f01e9-b89d-4192-af56-3ed78fe9ef6e-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:10:58 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=81,cinder:UPDATE=130,cinder:INSERT=30,cinder:DELETE=8 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:10:59 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=93,cinder:UPDATE=106,cinder:INSERT=27,cinder:DELETE=11 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (afec59b4-2c5e-4a0a-acd4-5ea962d63fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b4d001-aba0-4f73-83d1-d529afb2c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b4d001-aba0-4f73-83d1-d529afb2c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136964327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c035ff8-1ee4-44f1-9b88-3012576cccc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:01Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21282fc9-58b2-4793-aeaa-7f98bd919acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21282fc9-58b2-4793-aeaa-7f98bd919acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdf8628-f5dc-48ea-844f-8dac1de9f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdf8628-f5dc-48ea-844f-8dac1de9f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c035ff8-1ee4-44f1-9b88-3012576cccc0', 'volume_name': 'volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1634a3c-ad2c-4cb7-b76d-eadd9486fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1634a3c-ad2c-4cb7-b76d-eadd9486fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5943d377-989e-4c06-880a-1c06252e59f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume 6c035ff8-1ee4-44f1-9b88-3012576cccc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0', 'volume_size': 1} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-136964327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c035ff8-1ee4-44f1-9b88-3012576cccc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:01Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating volume 6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:01 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:01 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 1073741824 Jul 31 11:11:01 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Flow 'volume_create_manager' (0526ced9-4776-4c8f-95dc-2d6323f0bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8d4474-ec11-4c96-a8ff-fe8bd6e11869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8d4474-ec11-4c96-a8ff-fe8bd6e11869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2133776906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331a0440-6acf-4791-8d5d-4959127ef50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eb1ceca1f548b6b4ceaff9b76fccb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:01Z,use_quota=True,user_id='162059fd4e5540e8bad2d69abe4c78cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e47fee3-e62a-48fb-acff-d7a978832c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e47fee3-e62a-48fb-acff-d7a978832c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b567146-988b-4d27-9d58-0216aa6b43df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b567146-988b-4d27-9d58-0216aa6b43df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331a0440-6acf-4791-8d5d-4959127ef50f', 'volume_name': 'volume-331a0440-6acf-4791-8d5d-4959127ef50f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a5a28c-5d04-472c-9c91-b4937ce4f8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a5a28c-5d04-472c-9c91-b4937ce4f8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c7afdd-df58-4b98-adbb-a504c54f2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Volume 331a0440-6acf-4791-8d5d-4959127ef50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331a0440-6acf-4791-8d5d-4959127ef50f', 'volume_size': 1} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:01 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 1073741824" returned: 0 in 0.552s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:01 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 Jul 31 11:11:01 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:02 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0" returned: 0 in 0.282s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2133776906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331a0440-6acf-4791-8d5d-4959127ef50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eb1ceca1f548b6b4ceaff9b76fccb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:01Z,use_quota=True,user_id='162059fd4e5540e8bad2d69abe4c78cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Creating volume 331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:02 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5943d377-989e-4c06-880a-1c06252e59f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:02 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f 1073741824 Jul 31 11:11:02 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462454f9-ae27-420c-9390-a80f16805871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:02 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 (6c035ff8-1ee4-44f1-9b88-3012576cccc0): created successfully Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462454f9-ae27-420c-9390-a80f16805871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (afec59b4-2c5e-4a0a-acd4-5ea962d63fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:02 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e7b5d95b-476f-4b96-89a0-53fe4095fab4 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created volume successfully. Jul 31 11:11:02 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f 1073741824" returned: 0 in 0.565s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:02 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:02 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:02 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.323s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c7afdd-df58-4b98-adbb-a504c54f2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331a0440-6acf-4791-8d5d-4959127ef50f', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8dcce4-ac18-4f66-b1e9-9ed820558d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Volume volume-331a0440-6acf-4791-8d5d-4959127ef50f (331a0440-6acf-4791-8d5d-4959127ef50f): created successfully Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8dcce4-ac18-4f66-b1e9-9ed820558d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Flow 'volume_create_manager' (0526ced9-4776-4c8f-95dc-2d6323f0bc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4bef1359-f944-41b6-bce8-32b25385da9e tempest-VolumeDependencyTests-1026322202 None] Created volume successfully. Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating offline snapshot 6201904a-bf39-4220-b8f9-44e7353db14d of volume 6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d991c3-c391-4725-98a1-cdf23145cee8]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:03 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 Jul 31 11:11:03 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:03 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0" returned: 0 in 0.516s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:03 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d 1G Jul 31 11:11:03 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:04 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d 1G" returned: 0 in 0.506s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:04 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d Jul 31 11:11:04 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:04 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:04 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d is being set with open permissions: ugo+rw Jul 31 11:11:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:04 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d Jul 31 11:11:04 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:05 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d" returned: 0 in 0.281s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:05 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info Jul 31 11:11:05 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:05 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info" returned: 0 in 0.319s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:05 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info is being set with open permissions: ugo+rw Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:05 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info Jul 31 11:11:05 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Flow 'volume_create_manager' (34911ca0-d513-4ab9-a899-addda2ff8e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbe8722-f179-47d8-8f02-61ea70ab9aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.info" returned: 0 in 0.269s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.988s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cbe8722-f179-47d8-8f02-61ea70ab9aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a6757-fe17-49b6-a7c3-1f81d80f79ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17984a13c44e49c0b01adde77049fc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:06Z,use_quota=True,user_id='0118a5793bd5497199b7deec6135a880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(929763e2-e7c3-4232-bea5-98cd5691bf86),volume_type_id=929763e2-e7c3-4232-bea5-98cd5691bf86)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3790334-61df-4e63-9e10-594f24e210d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3790334-61df-4e63-9e10-594f24e210d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b94aa15-69bc-41c2-bed5-246192bf226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Creating offline snapshot fe0ee953-219c-4e4f-971c-77f63196e52e of volume 331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5235666a-9ec6-48af-9a87-5c68060eeb9b tempest-CreateVolumesFromSnapshotTest-1667589882 None] Create snapshot completed successfully Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[db988fe6-f085-486e-8a53-fccfb0151934]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:05 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:05 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:06 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.417s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:06 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e 1G Jul 31 11:11:06 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b94aa15-69bc-41c2-bed5-246192bf226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f79a6757-fe17-49b6-a7c3-1f81d80f79ee', 'volume_name': 'volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee', 'volume_size': 1, 'image_id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb17974c62a0a9a4b29dc1de95b94ae6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17984a13c44e49c0b01adde77049fc72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af54edd4ffeab18fde8c9bc8e26860eeeebc5cb28a2aeb17651449f03923a5bae1afba3ac2b0937fd3fd7ecb11ef3a803fe6c76e1f6dbc5cd8626b85f895b14f', 'id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'created_at': datetime.datetime(2026, 7, 31, 9, 11, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 11, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8f9f54-a3ac-4b27-b0fd-ef65dce39353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8f9f54-a3ac-4b27-b0fd-ef65dce39353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7212cfa-3c0b-4240-b602-4cca874301cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:06 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Volume f79a6757-fe17-49b6-a7c3-1f81d80f79ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee', 'volume_size': 1, 'image_id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb17974c62a0a9a4b29dc1de95b94ae6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17984a13c44e49c0b01adde77049fc72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af54edd4ffeab18fde8c9bc8e26860eeeebc5cb28a2aeb17651449f03923a5bae1afba3ac2b0937fd3fd7ecb11ef3a803fe6c76e1f6dbc5cd8626b85f895b14f', 'id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'created_at': datetime.datetime(2026, 7, 31, 9, 11, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 11, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Trying to clone f79a6757-fe17-49b6-a7c3-1f81d80f79ee from image 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 at location (None, [{'url': 'file:///opt/stack/data/glance/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:11:06 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aaee65-2c1d-45ac-9d65-0a190c6750f4]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:06 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e 1G" returned: 0 in 0.559s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331a0440-6acf-4791-8d5d-4959127ef50f -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:06 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331a0440-6acf-4791-8d5d-4959127ef50f -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e Jul 31 11:11:06 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:06 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD Jul 31 11:11:06 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (20d523b3-6eb4-4d05-a43d-0dee25e58b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a88594-3757-49a4-990c-b9ac247a73e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a88594-3757-49a4-990c-b9ac247a73e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200771800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed264dcb-5ab2-4289-b0c3-83b6225d6807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:07Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a541ab5f-fd21-489b-ad45-eee5885374b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a541ab5f-fd21-489b-ad45-eee5885374b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b875c771-844e-463f-b47b-1372173ff2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b875c771-844e-463f-b47b-1372173ff2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed264dcb-5ab2-4289-b0c3-83b6225d6807', 'volume_name': 'volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf6c3cd-4a46-4ee2-9a29-be81a74d35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf6c3cd-4a46-4ee2-9a29-be81a74d35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c16cd9-7fd6-4999-a3d5-e8a4b4de0789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume ed264dcb-5ab2-4289-b0c3-83b6225d6807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807', 'volume_size': 1} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-331a0440-6acf-4791-8d5d-4959127ef50f -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e" returned: 0 in 0.559s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e is being set with open permissions: ugo+rw Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD Jul 31 11:11:07 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e Jul 31 11:11:07 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD" returned: 1 in 0.552s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Temporary image 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 is fetched for user 0118a5793bd5497199b7deec6135a880. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (69a602e8-a89f-418e-8fed-fd731fdbd603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9657262-0ed8-4c00-802e-25fa1c2dc675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info Jul 31 11:11:07 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9657262-0ed8-4c00-802e-25fa1c2dc675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2116081330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1b8020-3b03-4e5d-b928-e79095b02740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2acd960-3957-41c8-9476-b5ae16b682c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2acd960-3957-41c8-9476-b5ae16b682c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ca00d7-5d5f-4271-a49b-e1a3077f6a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ca00d7-5d5f-4271-a49b-e1a3077f6a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1b8020-3b03-4e5d-b928-e79095b02740', 'volume_name': 'volume-4f1b8020-3b03-4e5d-b928-e79095b02740', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e6b682-f633-4797-8a45-22c08190ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e6b682-f633-4797-8a45-22c08190ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b600d6e-4935-4ff9-9d26-7f97443b72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume 4f1b8020-3b03-4e5d-b928-e79095b02740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1b8020-3b03-4e5d-b928-e79095b02740', 'volume_size': 1} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50edef-6a73-4f27-874e-9458bbcc5af6]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:07 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD Jul 31 11:11:08 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info" returned: 0 in 0.379s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info is being set with open permissions: ugo+rw Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:08 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info Jul 31 11:11:08 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (141674f1-a425-4860-acb1-00470dadff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f735e9-7704-4ceb-9213-a6c9af2b0b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f735e9-7704-4ceb-9213-a6c9af2b0b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066570419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158e2104-03b3-40d1-ab1e-19a3a4c23b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1717366-84a8-440d-87a7-820292501acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1717366-84a8-440d-87a7-820292501acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbbe9c47-2a9f-48b8-8756-cd546842be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbbe9c47-2a9f-48b8-8756-cd546842be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158e2104-03b3-40d1-ab1e-19a3a4c23b2c', 'volume_name': 'volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b057a8f0-1c90-4134-9556-c7e08bb5eca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b057a8f0-1c90-4134-9556-c7e08bb5eca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e362d590-07f8-4c2f-b7dc-0a5ceed290e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume 158e2104-03b3-40d1-ab1e-19a3a4c23b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c', 'volume_size': 1} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.info" returned: 0 in 0.374s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:08 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD Jul 31 11:11:08 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.220s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200771800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed264dcb-5ab2-4289-b0c3-83b6225d6807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:07Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating volume ed264dcb-5ab2-4289-b0c3-83b6225d6807 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:08 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:08 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 1073741824 Jul 31 11:11:08 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (4b70e2a1-3243-4a45-b471-555007f0e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5697dee-d789-4d98-9250-3f7f23129c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (c652d1c8-49c1-4f06-b903-25ddf887db6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5641e5ea-a18d-4be5-aefa-b04ea4e7c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5697dee-d789-4d98-9250-3f7f23129c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777273649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532a775d-5dfa-4258-82c1-fc25c9fa71a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1019043-20a1-4648-81dc-7fc9821f671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1019043-20a1-4648-81dc-7fc9821f671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900be308-07f0-4d7a-87e0-ab25b06a518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900be308-07f0-4d7a-87e0-ab25b06a518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532a775d-5dfa-4258-82c1-fc25c9fa71a0', 'volume_name': 'volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b54cbc7-5bae-4306-9436-9cb0580d7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b54cbc7-5bae-4306-9436-9cb0580d7df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9856a09c-355f-4e80-96a3-7daf9145b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Volume 532a775d-5dfa-4258-82c1-fc25c9fa71a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0', 'volume_size': 1} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-cb54348f-7e6d-4612-9eae-e11b85cf9ed8 tempest-VolumeDependencyTests-1026322202 None] Create snapshot completed successfully Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5641e5ea-a18d-4be5-aefa-b04ea4e7c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2049642976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643ef23a-a9b8-4868-bff8-3796e3f8ace7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698b95dd-e8df-4c56-9a7c-180d78217cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698b95dd-e8df-4c56-9a7c-180d78217cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2272348d-1685-47f6-b3e1-071e68c2dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2272348d-1685-47f6-b3e1-071e68c2dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '643ef23a-a9b8-4868-bff8-3796e3f8ace7', 'volume_name': 'volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd8c430-3269-42e9-9f81-d06333fa2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd8c430-3269-42e9-9f81-d06333fa2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d2a463-e2bc-48ee-91db-4b07aead42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume 643ef23a-a9b8-4868-bff8-3796e3f8ace7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7', 'volume_size': 1} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:08 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD" returned: 1 in 0.551s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:08 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:08 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (84b836e8-189a-413f-a652-e291a709006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d472f497-1360-4b06-bc65-34a9e65baab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 1073741824" returned: 0 in 0.555s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d472f497-1360-4b06-bc65-34a9e65baab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906409998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ab6a4a-f72d-4217-91d1-2326d66cd3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:09Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1100d1e-8b92-4efc-8d94-7f5f498f36f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1100d1e-8b92-4efc-8d94-7f5f498f36f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97efc182-4760-47d4-8a83-b0b0a30063fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97efc182-4760-47d4-8a83-b0b0a30063fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ab6a4a-f72d-4217-91d1-2326d66cd3eb', 'volume_name': 'volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca686b28-dcf1-49b0-b48c-246498982337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca686b28-dcf1-49b0-b48c-246498982337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794e2a4-d841-4531-ac55-3a5ddc53c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume b0ab6a4a-f72d-4217-91d1-2326d66cd3eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb', 'volume_size': 1} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:09 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 Jul 31 11:11:09 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:09 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807" returned: 0 in 0.279s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.632s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2116081330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1b8020-3b03-4e5d-b928-e79095b02740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating volume 4f1b8020-3b03-4e5d-b928-e79095b02740 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:09 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c16cd9-7fd6-4999-a3d5-e8a4b4de0789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 1073741824 Jul 31 11:11:09 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796f8413-41c9-417f-930a-63afa741202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 (ed264dcb-5ab2-4289-b0c3-83b6225d6807): created successfully Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796f8413-41c9-417f-930a-63afa741202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (20d523b3-6eb4-4d05-a43d-0dee25e58b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-765e70cd-a5a6-4102-9158-8e105b8a9b54 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created volume successfully. Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Flow 'volume_create_manager' (af55bc68-f808-494a-abcd-820b0112f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdea9b97-191f-41bd-b85d-db36cd900e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdea9b97-191f-41bd-b85d-db36cd900e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-69246876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19abc593-0683-4521-a9cc-03cfeec881e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eb1ceca1f548b6b4ceaff9b76fccb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe0ee953-219c-4e4f-971c-77f63196e52e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:10Z,use_quota=True,user_id='162059fd4e5540e8bad2d69abe4c78cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24c20ac-8aae-4521-9880-95242c7b9c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24c20ac-8aae-4521-9880-95242c7b9c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04dccf5-e44c-4c8e-a17e-2ca64af8a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04dccf5-e44c-4c8e-a17e-2ca64af8a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19abc593-0683-4521-a9cc-03cfeec881e5', 'volume_name': 'volume-19abc593-0683-4521-a9cc-03cfeec881e5', 'volume_size': 1, 'snapshot_id': 'fe0ee953-219c-4e4f-971c-77f63196e52e'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c7ec99-455d-41c3-9d7b-c457cdff3885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c7ec99-455d-41c3-9d7b-c457cdff3885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbb2986-9513-40b0-b7f3-e4e1148b4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Volume 19abc593-0683-4521-a9cc-03cfeec881e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19abc593-0683-4521-a9cc-03cfeec881e5', 'volume_size': 1, 'snapshot_id': 'fe0ee953-219c-4e4f-971c-77f63196e52e'} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:09 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 1073741824" returned: 0 in 0.439s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:09 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 Jul 31 11:11:09 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:10 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740" returned: 0 in 0.251s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066570419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158e2104-03b3-40d1-ab1e-19a3a4c23b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating volume 158e2104-03b3-40d1-ab1e-19a3a4c23b2c {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:10 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b600d6e-4935-4ff9-9d26-7f97443b72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1b8020-3b03-4e5d-b928-e79095b02740', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:10 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c 1073741824 Jul 31 11:11:10 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8ef28c-e7eb-4056-be16-b8120654c3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:10 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume volume-4f1b8020-3b03-4e5d-b928-e79095b02740 (4f1b8020-3b03-4e5d-b928-e79095b02740): created successfully Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8ef28c-e7eb-4056-be16-b8120654c3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (69a602e8-a89f-418e-8fed-fd731fdbd603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6967c0b9-7c25-4a73-b8e2-52c9e8d37668 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created volume successfully. Jul 31 11:11:10 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c 1073741824" returned: 0 in 0.470s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:10 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c Jul 31 11:11:10 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:10 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c" returned: 0 in 0.244s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777273649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532a775d-5dfa-4258-82c1-fc25c9fa71a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Creating volume 532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:10 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e362d590-07f8-4c2f-b7dc-0a5ceed290e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:10 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 1073741824 Jul 31 11:11:10 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cba9fa2-518a-4464-b545-a77b91299d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:10 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c (158e2104-03b3-40d1-ab1e-19a3a4c23b2c): created successfully Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cba9fa2-518a-4464-b545-a77b91299d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (141674f1-a425-4860-acb1-00470dadff4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6b49802a-eae8-4051-b545-e92d92f74f3f tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created volume successfully. Jul 31 11:11:11 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 1073741824" returned: 0 in 0.472s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:11 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 Jul 31 11:11:11 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:11 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0" returned: 0 in 0.265s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.992s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2049642976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643ef23a-a9b8-4868-bff8-3796e3f8ace7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:08Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating volume 643ef23a-a9b8-4868-bff8-3796e3f8ace7 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:11 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9856a09c-355f-4e80-96a3-7daf9145b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:11 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 1073741824 Jul 31 11:11:11 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc36f7-7ccd-4a29-bdea-1a8dfc163d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:11 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Volume volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 (532a775d-5dfa-4258-82c1-fc25c9fa71a0): created successfully Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdc36f7-7ccd-4a29-bdea-1a8dfc163d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (4b70e2a1-3243-4a45-b471-555007f0e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e233a189-4da6-48bb-b93c-49cff54a1fd1 tempest-ProjectReaderTests-309693554 None] Created volume successfully. Jul 31 11:11:12 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 1073741824" returned: 0 in 0.409s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:12 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 Jul 31 11:11:12 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:12 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.652s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79a6757-fe17-49b6-a7c3-1f81d80f79ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17984a13c44e49c0b01adde77049fc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:06Z,use_quota=True,user_id='0118a5793bd5497199b7deec6135a880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(929763e2-e7c3-4232-bea5-98cd5691bf86),volume_type_id=929763e2-e7c3-4232-bea5-98cd5691bf86)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Creating volume f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:12 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d2a463-e2bc-48ee-91db-4b07aead42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:12 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee 1073741824 Jul 31 11:11:12 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6f0470-8005-4263-bb03-1ce8229a8893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:12 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 (643ef23a-a9b8-4868-bff8-3796e3f8ace7): created successfully Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6f0470-8005-4263-bb03-1ce8229a8893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (c652d1c8-49c1-4f06-b903-25ddf887db6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:12 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7d5d20a9-27b7-4018-9a3b-3bca0b1dba19 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created volume successfully. Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:12 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee 1073741824" returned: 0 in 0.449s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:13 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:13 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 0 in 0.250s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.118s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906409998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ab6a4a-f72d-4217-91d1-2326d66cd3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a3ef488c841a2b49e0fd1f6fdde24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:09Z,use_quota=True,user_id='6002b680bd6143cc87d39627a70efc08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Creating volume b0ab6a4a-f72d-4217-91d1-2326d66cd3eb {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:13 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb 1073741824 Jul 31 11:11:13 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Attempting download of 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 ((None, [{'url': 'file:///opt/stack/data/glance/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'metadata': {}}])) to volume f79a6757-fe17-49b6-a7c3-1f81d80f79ee. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5679826b-65db-41de-a6bd-b955bc492dfb]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3 Jul 31 11:11:13 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:13 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:13 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3" returned: 0 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb 1073741824" returned: 0 in 0.469s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:13 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb Jul 31 11:11:13 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:13 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3 Jul 31 11:11:13 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb" returned: 0 in 0.246s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.352s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-quobyte-fe0ee953-219c-4e4f-971c-77f63196e52e-19abc593-0683-4521-a9cc-03cfeec881e5" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794e2a4-d841-4531-ac55-3a5ddc53c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb278c-9921-41ca-947f-14b255243120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:14 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-fe0ee953-219c-4e4f-971c-77f63196e52e-19abc593-0683-4521-a9cc-03cfeec881e5" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Creating volume 19abc593-0683-4521-a9cc-03cfeec881e5 from snapshot fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-quobyte-19abc593-0683-4521-a9cc-03cfeec881e5" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3" returned: 1 in 0.370s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_bldwnis3' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:11:14 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Volume volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb (b0ab6a4a-f72d-4217-91d1-2326d66cd3eb): created successfully Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fb278c-9921-41ca-947f-14b255243120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Flow 'volume_create_manager' (84b836e8-189a-413f-a652-e291a709006c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9351d4cf-0263-4ef8-8e8e-e87823362d9f]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-19abc593-0683-4521-a9cc-03cfeec881e5" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] snapshot: fe0ee953-219c-4e4f-971c-77f63196e52e, volume: 19abc593-0683-4521-a9cc-03cfeec881e5, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:11:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a27a0013-c8b4-47cf-b2e4-977d14cd95d6 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created volume successfully. Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3560f310-74ff-470e-bf80-24f8709d0d6b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD Jul 31 11:11:14 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e Jul 31 11:11:14 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808aa19-f6f1-4491-9109-0083165965cd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD Jul 31 11:11:14 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e" returned: 0 in 0.498s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-331a0440-6acf-4791-8d5d-4959127ef50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da6af6-cd4b-4f50-ac45-705642613ea2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb Jul 31 11:11:14 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:14 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:14 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 was raw, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:11:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:14 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:14 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb" returned: 0 in 0.471s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:15 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.442s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb Jul 31 11:11:15 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:15 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 Jul 31 11:11:15 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 0 in 0.416s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620_9j0gyahudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:11:15 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:15 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee 1G Jul 31 11:11:15 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb" returned: 0 in 0.325s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb" released by "delete_volume" :: held 0.851s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['e5420b45-4052-4a23-8485-4cc5c66ed3c3', '173fabb7-0c3f-498b-ba73-070c50d41b8c', '38972cae-81f0-4df5-919d-50d635f5833e', '0a5a34a1-cd86-4626-b4a1-8a388bf463c2'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:15 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:15 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-643ef23a-a9b8-4868-bff8-3796e3f8ace7-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:15 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee 1G" returned: 0 in 0.462s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-643ef23a-a9b8-4868-bff8-3796e3f8ace7-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921945c-2295-412a-a4a2-abfe08440051]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-643ef23a-a9b8-4868-bff8-3796e3f8ace7" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-643ef23a-a9b8-4868-bff8-3796e3f8ace7" acquired by "delete_volume" :: waited 0.072s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:16 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.531s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleted volume successfully. Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db4c189-5b2e-48f9-8b34-eac22e20fef2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:16 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:16 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7a511114-6f1d-47cd-b278-fe18e8530297 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-b0ab6a4a-f72d-4217-91d1-2326d66cd3eb-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:16 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 Jul 31 11:11:16 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:16 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 0 in 0.941s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:17 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:17 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:17 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7" returned: 0 in 1.005s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:17 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7 Jul 31 11:11:17 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:17 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 1 in 0.888s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Downloaded image 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 ((None, [{'url': 'file:///opt/stack/data/glance/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'metadata': {}}])) to volume f79a6757-fe17-49b6-a7c3-1f81d80f79ee successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Temporary image 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 for user 0118a5793bd5497199b7deec6135a880 is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Marking volume f79a6757-fe17-49b6-a7c3-1f81d80f79ee as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:11:17 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-643ef23a-a9b8-4868-bff8-3796e3f8ace7" returned: 0 in 0.591s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-643ef23a-a9b8-4868-bff8-3796e3f8ace7" released by "delete_volume" :: held 1.729s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Copying metadata from image 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 to f79a6757-fe17-49b6-a7c3-1f81d80f79ee. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:11:17 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Creating volume glance metadata for volume f79a6757-fe17-49b6-a7c3-1f81d80f79ee backed by image 48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cb17974c62a0a9a4b29dc1de95b94ae6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['45963cc9-a82e-445f-beb9-61b3e8a1de59', '3e66b95b-a6db-4621-89cc-9b96ab0eedfe', '4536cd87-0aca-42c1-80a2-a1e6ae025506', '501857cc-485e-4225-b5d3-fe8ca5638db7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7212cfa-3c0b-4240-b602-4cca874301cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee', 'volume_size': 1, 'image_id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb17974c62a0a9a4b29dc1de95b94ae6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17984a13c44e49c0b01adde77049fc72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'af54edd4ffeab18fde8c9bc8e26860eeeebc5cb28a2aeb17651449f03923a5bae1afba3ac2b0937fd3fd7ecb11ef3a803fe6c76e1f6dbc5cd8626b85f895b14f', 'id': '48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620', 'created_at': datetime.datetime(2026, 7, 31, 9, 11, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 11, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48e0e3b8-a0c9-4811-81d8-1ec0dfbf8620/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b562ca-1370-4a96-87aa-11948ae88182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:18 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Volume volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee (f79a6757-fe17-49b6-a7c3-1f81d80f79ee): created successfully Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b562ca-1370-4a96-87aa-11948ae88182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Flow 'volume_create_manager' (34911ca0-d513-4ab9-a899-addda2ff8e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-15793b42-9285-4999-befb-0196860abed5 tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Created volume successfully. Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:18 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:18 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:18 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.325s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleted volume successfully. Jul 31 11:11:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-efb77e73-1c1d-4bb8-bdcb-10a7c45e9fff tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-643ef23a-a9b8-4868-bff8-3796e3f8ace7-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Acquiring lock "cinder-f79a6757-fe17-49b6-a7c3-1f81d80f79ee-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "cinder-f79a6757-fe17-49b6-a7c3-1f81d80f79ee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Acquiring lock "cinder-quobyte-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "cinder-quobyte-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf36841-227b-4a02-b720-b19775a9ebe8]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-158e2104-03b3-40d1-ab1e-19a3a4c23b2c-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-158e2104-03b3-40d1-ab1e-19a3a4c23b2c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-158e2104-03b3-40d1-ab1e-19a3a4c23b2c" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-158e2104-03b3-40d1-ab1e-19a3a4c23b2c" acquired by "delete_volume" :: waited 0.037s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:19 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:19 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda24cc3-d987-40f5-9634-d86cf978d4ed]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:20 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c Jul 31 11:11:20 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:20 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 0 in 1.103s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:20 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c" returned: 0 in 0.928s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:20 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c Jul 31 11:11:20 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:20 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:20 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:20 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5" returned: 0 in 5.786s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14bd98b-b5d1-405e-95ef-21a5a7edeab4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:21 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 1 in 0.750s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-158e2104-03b3-40d1-ab1e-19a3a4c23b2c" returned: 0 in 0.467s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-158e2104-03b3-40d1-ab1e-19a3a4c23b2c" released by "delete_volume" :: held 1.482s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:21 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['18e3fc92-ea44-4b1e-ab0a-bf3db66e5ae3', 'cd8fe104-6ba7-4f94-ab1e-9877090f67c1', 'eb9a4b51-6ea8-4aca-948f-a2470cf9aa4c', 'a0036c4d-65b6-4a38-b3fd-aebc018ba490'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:21 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" returned: 0 in 0.295s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "cinder-quobyte-f79a6757-fe17-49b6-a7c3-1f81d80f79ee" released by "delete_volume" :: held 2.262s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Created reservations ['cc4b2bef-eca8-48c9-8aa9-0be3fd988fe9', '60407799-d44c-4d4c-820b-2f50b2e26c5d', 'fd26abb1-cece-4051-a2e5-0c3a600a7ef1', 'e53bb84e-6892-4840-abf0-bb17a6317931'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.281s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleted volume successfully. Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.625s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:11:21 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Converted 1024.00 MB image at 176.93 MB/s Jul 31 11:11:21 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:21 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 is being set with open permissions: ugo+rw Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a21808f6-515d-495c-8811-113730c893d7 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-158e2104-03b3-40d1-ab1e-19a3a4c23b2c-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:21 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 Jul 31 11:11:21 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:21 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.283s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Deleted volume successfully. Jul 31 11:11:21 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5" returned: 0 in 0.276s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-19abc593-0683-4521-a9cc-03cfeec881e5" released by "_copy_volume_from_snapshot" :: held 7.747s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4b3a3bc5-8ec1-4f4b-ae3a-1f677d483e2e tempest-VolumeAndVolumeTypeFromImageTest-173392691 None] Lock "cinder-f79a6757-fe17-49b6-a7c3-1f81d80f79ee-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-fe0ee953-219c-4e4f-971c-77f63196e52e-19abc593-0683-4521-a9cc-03cfeec881e5" released by "_create_volume_from_snapshot" :: held 7.815s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.859s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.286s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Creating offline snapshot 626c1ae8-afdb-4d7b-a02c-67fd34050e74 of volume 532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbb2986-9513-40b0-b7f3-e4e1148b4c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19abc593-0683-4521-a9cc-03cfeec881e5', 'volume_size': 1, 'snapshot_id': 'fe0ee953-219c-4e4f-971c-77f63196e52e'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207d5b7e-a82c-4072-9cbe-d50845092d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a389d5-a0d0-43b1-885b-9aca44c41da0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-4f1b8020-3b03-4e5d-b928-e79095b02740-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:21 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Volume volume-19abc593-0683-4521-a9cc-03cfeec881e5 (19abc593-0683-4521-a9cc-03cfeec881e5): created successfully Jul 31 11:11:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207d5b7e-a82c-4072-9cbe-d50845092d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Flow 'volume_create_manager' (af55bc68-f808-494a-abcd-820b0112f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-4f1b8020-3b03-4e5d-b928-e79095b02740-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ebfc87af-3b97-495a-a258-11c828c295d5 tempest-VolumeDependencyTests-1026322202 None] Created volume successfully. Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-4f1b8020-3b03-4e5d-b928-e79095b02740" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-4f1b8020-3b03-4e5d-b928-e79095b02740" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 Jul 31 11:11:22 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf471fb-b750-4996-83c3-4e98cee71edb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:22 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 Jul 31 11:11:22 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:22 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0" returned: 0 in 0.454s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:22 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 1G Jul 31 11:11:22 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:22 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740" returned: 0 in 0.445s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:22 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740 Jul 31 11:11:22 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-fe0ee953-219c-4e4f-971c-77f63196e52e-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-fe0ee953-219c-4e4f-971c-77f63196e52e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-quobyte-331a0440-6acf-4791-8d5d-4959127ef50f" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-331a0440-6acf-4791-8d5d-4959127ef50f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-quobyte-fe0ee953-219c-4e4f-971c-77f63196e52e" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-fe0ee953-219c-4e4f-971c-77f63196e52e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Deleting offline snapshot fe0ee953-219c-4e4f-971c-77f63196e52e of volume 331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:22 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] snapshot_file for this snap is: volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4f1b8020-3b03-4e5d-b928-e79095b02740" returned: 0 in 0.379s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ce20bd-61d0-45ff-92b5-5f259d0dfeed]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-4f1b8020-3b03-4e5d-b928-e79095b02740" released by "delete_volume" :: held 0.894s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:22 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 1G" returned: 0 in 0.581s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 Jul 31 11:11:23 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['31fc8b49-9e78-401b-b5eb-2dc158067e01', 'ffbc4b51-d293-48ed-bdf4-019bb1421127', '745bf1d8-fa74-4401-8a6f-b49fe3acacc1', '5377c8a8-c3fd-4827-81fe-4a6c79c5a162'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:23 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e Jul 31 11:11:23 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:23 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-331a0440-6acf-4791-8d5d-4959127ef50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:23 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74" returned: 0 in 0.439s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 is being set with open permissions: ugo+rw Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[12610cb8-5f22-4038-b172-83460fd34f05]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 Jul 31 11:11:23 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.329s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleted volume successfully. Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-05d11086-e6f7-47b7-a2c5-55950e698353 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-4f1b8020-3b03-4e5d-b928-e79095b02740-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:23 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:23 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74" returned: 0 in 0.287s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info Jul 31 11:11:23 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:23 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:23 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e Jul 31 11:11:23 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:24 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info" returned: 0 in 0.293s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:24 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info is being set with open permissions: ugo+rw Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:24 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info Jul 31 11:11:24 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-ed264dcb-5ab2-4289-b0c3-83b6225d6807-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-ed264dcb-5ab2-4289-b0c3-83b6225d6807-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:24 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e" returned: 0 in 0.457s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-ed264dcb-5ab2-4289-b0c3-83b6225d6807" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:24 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e Jul 31 11:11:24 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:24 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.info" returned: 0 in 0.341s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-ed264dcb-5ab2-4289-b0c3-83b6225d6807" acquired by "delete_volume" :: waited 0.045s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[467ff702-fc44-4704-9035-610f58332789]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fc0919f4-36cd-42f2-a832-b10dbd7ac50c tempest-ProjectReaderTests-309693554 None] Create snapshot completed successfully Jul 31 11:11:24 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 Jul 31 11:11:24 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:24 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f.fe0ee953-219c-4e4f-971c-77f63196e52e" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-fe0ee953-219c-4e4f-971c-77f63196e52e" released by "_delete_snapshot" :: held 1.823s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-331a0440-6acf-4791-8d5d-4959127ef50f" released by "delete_snapshot" :: held 1.867s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Created reservations ['71be2bff-b160-4ebe-bf21-6e0134242de2', '673ad5a0-b10e-4c00-910c-bd0c7d380dc9', '8c71640c-bf01-4255-a118-4fbf1f4b5fa3', '9e1a9b77-d44e-4468-9f67-8d4c8cd24cc3'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:24 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Delete snapshot completed successfully. Jul 31 11:11:24 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-19e6d1fb-975c-4368-810a-ef30b5e7ff34 tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-fe0ee953-219c-4e4f-971c-77f63196e52e-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807" returned: 0 in 0.460s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:24 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807 Jul 31 11:11:24 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-331a0440-6acf-4791-8d5d-4959127ef50f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-331a0440-6acf-4791-8d5d-4959127ef50f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-quobyte-331a0440-6acf-4791-8d5d-4959127ef50f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-331a0440-6acf-4791-8d5d-4959127ef50f" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6962eb0b-0de2-407d-878a-e2f4c371832c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed264dcb-5ab2-4289-b0c3-83b6225d6807" returned: 0 in 0.308s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-ed264dcb-5ab2-4289-b0c3-83b6225d6807" released by "delete_volume" :: held 0.834s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:25 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:25 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['af37e0a6-2d93-4749-a276-20236fcf9fe7', 'c4cad8c6-7b6b-4595-8dc6-fff765845a47', 'd1c6caf4-1b88-49b1-8e0e-8d31e22faf2e', '0eebbbb8-d64d-4bd5-a14b-26647fe81a15'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:25 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-6201904a-bf39-4220-b8f9-44e7353db14d-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-6201904a-bf39-4220-b8f9-44e7353db14d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-6c035ff8-1ee4-44f1-9b88-3012576cccc0" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-6c035ff8-1ee4-44f1-9b88-3012576cccc0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-6201904a-bf39-4220-b8f9-44e7353db14d" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-6201904a-bf39-4220-b8f9-44e7353db14d" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleting offline snapshot 6201904a-bf39-4220-b8f9-44e7353db14d of volume 6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] snapshot_file for this snap is: volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c883b9-3909-438c-8edc-f4e22a6fb6bb]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.581s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:25 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f Jul 31 11:11:25 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-626c1ae8-afdb-4d7b-a02c-67fd34050e74-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Lock "cinder-626c1ae8-afdb-4d7b-a02c-67fd34050e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-532a775d-5dfa-4258-82c1-fc25c9fa71a0" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-532a775d-5dfa-4258-82c1-fc25c9fa71a0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-626c1ae8-afdb-4d7b-a02c-67fd34050e74" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-626c1ae8-afdb-4d7b-a02c-67fd34050e74" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Deleting offline snapshot 626c1ae8-afdb-4d7b-a02c-67fd34050e74 of volume 532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:25 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d Jul 31 11:11:25 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:25 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] snapshot_file for this snap is: volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.514s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:25 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleted volume successfully. Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[040eb36f-104e-4d42-85a7-f3d60f58c10d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ca18ca5c-eb95-4667-937d-80d25d08fe09 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-ed264dcb-5ab2-4289-b0c3-83b6225d6807-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:26 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-331a0440-6acf-4791-8d5d-4959127ef50f" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-331a0440-6acf-4791-8d5d-4959127ef50f" released by "delete_volume" :: held 1.015s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:26 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 Jul 31 11:11:26 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Created reservations ['0b37d4d5-82bd-4246-af7a-e828e52f5c8d', 'de2883c8-2b88-40a7-858e-632acb5f9852', 'dcfaa09d-2d37-4cf9-8b71-8dbc773d23f7', 'aa71573e-6b06-4c6a-bd4a-51944769a833'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d" returned: 0 in 0.631s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:26 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:26 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b1b7b-b60a-4689-bf25-805a5a2c6fa6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74" returned: 0 in 0.487s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:26 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 Jul 31 11:11:26 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e5fb6-e64b-4349-a658-0cf1ad2813fd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.287s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Deleted volume successfully. Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e846d7f6-3299-4c23-ae5f-a4fab295b19e tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-331a0440-6acf-4791-8d5d-4959127ef50f-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:26 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 Jul 31 11:11:26 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:26 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0" returned: 0 in 0.421s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:26 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d Jul 31 11:11:26 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:26 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0" returned: 0 in 0.481s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:27 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 Jul 31 11:11:27 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:27 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d" returned: 0 in 0.394s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:27 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d Jul 31 11:11:27 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-19abc593-0683-4521-a9cc-03cfeec881e5-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-19abc593-0683-4521-a9cc-03cfeec881e5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:27 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74" returned: 0 in 0.406s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "cinder-quobyte-19abc593-0683-4521-a9cc-03cfeec881e5" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:27 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74 Jul 31 11:11:27 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-19abc593-0683-4521-a9cc-03cfeec881e5" acquired by "delete_volume" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60c35ab-1539-4eb8-8d55-d702ca8fdfc2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:27 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0.6201904a-bf39-4220-b8f9-44e7353db14d" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-6201904a-bf39-4220-b8f9-44e7353db14d" released by "_delete_snapshot" :: held 1.898s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-6c035ff8-1ee4-44f1-9b88-3012576cccc0" released by "delete_snapshot" :: held 1.944s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:27 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['9094b926-e303-4625-9ef4-a109f5a5c0d7', '12eeb33c-0550-4fb2-9460-ad2755978a25', '3ddeb282-b8c2-467d-98cc-fd780779a74f', '5223eb46-834b-4b4d-8554-e479a62f179e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:27 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:27 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0.626c1ae8-afdb-4d7b-a02c-67fd34050e74" returned: 0 in 0.323s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Delete snapshot completed successfully. Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-17d6faa5-f51e-4aea-a487-c26d83ef336a tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-6201904a-bf39-4220-b8f9-44e7353db14d-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-626c1ae8-afdb-4d7b-a02c-67fd34050e74" released by "_delete_snapshot" :: held 1.838s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-532a775d-5dfa-4258-82c1-fc25c9fa71a0" released by "delete_snapshot" :: held 1.873s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Created reservations ['db8f0675-1ef3-4647-a471-daffd702e2be', '47e0b924-25ca-426c-97fc-58722d509f59', 'b0e90f75-ffcc-47cb-a591-83d4ad92a875', '3f8a636c-82a5-4a3d-a1a7-223d8dfa5020'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:27 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Delete snapshot completed successfully. Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-cf1daed0-9017-4eed-a7bd-9b0d8409c501 tempest-ProjectReaderTests-309693554 None] Lock "cinder-626c1ae8-afdb-4d7b-a02c-67fd34050e74-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:27 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5" returned: 0 in 0.512s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5 Jul 31 11:11:28 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-532a775d-5dfa-4258-82c1-fc25c9fa71a0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Lock "cinder-532a775d-5dfa-4258-82c1-fc25c9fa71a0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-532a775d-5dfa-4258-82c1-fc25c9fa71a0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (d08daf33-d3c6-45e6-87f9-e46bdf62517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16b8206-8d64-4bad-878c-7c024cd04053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-532a775d-5dfa-4258-82c1-fc25c9fa71a0" acquired by "delete_volume" :: waited 0.046s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16b8206-8d64-4bad-878c-7c024cd04053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1405358363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82af529b-c754-48bb-8739-284b70ffbbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:28Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aac04d8-9944-4954-9b53-5a0479b070d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aac04d8-9944-4954-9b53-5a0479b070d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a78534-30a2-4c32-a6f9-02709b884b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a78534-30a2-4c32-a6f9-02709b884b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82af529b-c754-48bb-8739-284b70ffbbf3', 'volume_name': 'volume-82af529b-c754-48bb-8739-284b70ffbbf3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aca6eb-fec9-40b1-be90-f53d3aecda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aca6eb-fec9-40b1-be90-f53d3aecda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a8bae4-2835-4b13-8ca1-b19e362ae730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Volume 82af529b-c754-48bb-8739-284b70ffbbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82af529b-c754-48bb-8739-284b70ffbbf3', 'volume_size': 1} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1405358363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82af529b-c754-48bb-8739-284b70ffbbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:28Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Creating volume 82af529b-c754-48bb-8739-284b70ffbbf3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:28 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf535ab-4e71-471a-b6e0-324f5bd4853c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 1073741824 Jul 31 11:11:28 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-19abc593-0683-4521-a9cc-03cfeec881e5" returned: 0 in 0.361s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-quobyte-19abc593-0683-4521-a9cc-03cfeec881e5" released by "delete_volume" :: held 0.931s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:28 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 Jul 31 11:11:28 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Created reservations ['3c83fd85-edad-4ac4-acff-e41565e046cd', 'dfeef51b-527c-47c2-926a-58ffdaf49754', 'ad816c6f-8af7-4c21-964b-07944130c7f6', 'e2f95369-ef56-4877-aa10-3cecd995881c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:28 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (6a9c0b3f-04b0-40b8-9ae1-d8f8cbd0dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29419cc2-0578-48b7-9682-6fe75b65d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-6c035ff8-1ee4-44f1-9b88-3012576cccc0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:28 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29419cc2-0578-48b7-9682-6fe75b65d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824598723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115d7b35-918f-4422-afac-d287c1e2fcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:29Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8df9a63-4d32-4f4a-8c98-eed31ca25398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8df9a63-4d32-4f4a-8c98-eed31ca25398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4bbbf9-2472-4557-a6fc-f5335cc31b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4bbbf9-2472-4557-a6fc-f5335cc31b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115d7b35-918f-4422-afac-d287c1e2fcf3', 'volume_name': 'volume-115d7b35-918f-4422-afac-d287c1e2fcf3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c398d604-3d55-48f8-99bb-4e4f117c83df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c398d604-3d55-48f8-99bb-4e4f117c83df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a96dfab-7d92-43d9-a6f0-6a3064eb2305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Volume 115d7b35-918f-4422-afac-d287c1e2fcf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115d7b35-918f-4422-afac-d287c1e2fcf3', 'volume_size': 1} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0" returned: 0 in 0.613s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:28 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-6c035ff8-1ee4-44f1-9b88-3012576cccc0-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:28 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0 Jul 31 11:11:28 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "cinder-quobyte-6c035ff8-1ee4-44f1-9b88-3012576cccc0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-6c035ff8-1ee4-44f1-9b88-3012576cccc0" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:29 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 1073741824" returned: 0 in 0.789s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.443s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d334d8a-8e5f-4b9b-ab2f-0202722cbc46]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Deleted volume successfully. Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9aae810d-39af-4b7d-aa41-631e2928b87d tempest-VolumeDependencyTests-1026322202 None] Lock "cinder-19abc593-0683-4521-a9cc-03cfeec881e5-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:29 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 Jul 31 11:11:29 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 Jul 31 11:11:29 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-532a775d-5dfa-4258-82c1-fc25c9fa71a0" returned: 0 in 0.387s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (91c5a194-e700-416b-9c06-076d386ec2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4b2868-4235-4efb-a64b-e530af3ac002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-532a775d-5dfa-4258-82c1-fc25c9fa71a0" released by "delete_volume" :: held 1.185s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4b2868-4235-4efb-a64b-e530af3ac002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615953049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e282c9-b8e0-4164-836f-ebfdba9fed45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:29Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc224369-34be-4021-90ff-1653867f998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc224369-34be-4021-90ff-1653867f998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16352963-e085-40c6-a761-de4549115650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16352963-e085-40c6-a761-de4549115650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e282c9-b8e0-4164-836f-ebfdba9fed45', 'volume_name': 'volume-61e282c9-b8e0-4164-836f-ebfdba9fed45', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1be92a-c6ed-4f3a-8147-600bc13a8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1be92a-c6ed-4f3a-8147-600bc13a8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d21e919-4345-4643-8745-549d08f98b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Volume 61e282c9-b8e0-4164-836f-ebfdba9fed45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e282c9-b8e0-4164-836f-ebfdba9fed45', 'volume_size': 1} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:29 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3" returned: 0 in 0.325s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824598723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115d7b35-918f-4422-afac-d287c1e2fcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:29Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Creating volume 115d7b35-918f-4422-afac-d287c1e2fcf3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:29 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a8bae4-2835-4b13-8ca1-b19e362ae730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82af529b-c754-48bb-8739-284b70ffbbf3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 1073741824 Jul 31 11:11:29 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57217576-e8cb-4975-b84a-bec35b0683e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Created reservations ['e728688b-bd41-44d7-ae8e-52b73d157245', '3bf3a2d9-8918-4da1-a42d-33d090665cd8', 'f64c307d-75d7-4718-bc51-fd2ed233654d', 'e081f345-3ef3-4933-8655-5f4740e04940'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Volume volume-82af529b-c754-48bb-8739-284b70ffbbf3 (82af529b-c754-48bb-8739-284b70ffbbf3): created successfully Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57217576-e8cb-4975-b84a-bec35b0683e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (d08daf33-d3c6-45e6-87f9-e46bdf62517d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-19bdfa88-0ef9-4030-9c8a-b7a8a2cd6081 tempest-CreateVolumesFromImageTest-1230918398 None] Created volume successfully. Jul 31 11:11:29 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0" returned: 0 in 0.641s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:29 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0 Jul 31 11:11:29 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (3447d74c-91b8-4f2e-9fe8-0f453d513d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885465a3-0ae2-4597-b256-4f72b332842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885465a3-0ae2-4597-b256-4f72b332842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379021965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:30Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23e2778-c35f-4324-bd6c-9d800b33deb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23e2778-c35f-4324-bd6c-9d800b33deb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93db273-97f4-4216-8a98-3dc4dc0b3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93db273-97f4-4216-8a98-3dc4dc0b3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d', 'volume_name': 'volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572c866e-e054-43e4-89e4-137eae8ec128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572c866e-e054-43e4-89e4-137eae8ec128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd763fd0-eeaf-484a-8da6-bf8c66c7df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Volume 46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d', 'volume_size': 1} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:30 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6c035ff8-1ee4-44f1-9b88-3012576cccc0" returned: 0 in 0.358s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-quobyte-6c035ff8-1ee4-44f1-9b88-3012576cccc0" released by "delete_volume" :: held 1.094s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Created reservations ['29c63758-82d9-4274-93da-f53dbacafe75', '5924e0dc-d66c-4ad6-bf3f-a86cafb9b1f2', '39aa87df-b34f-475c-b8ce-9fbc395ac4ff', 'c7c4089d-0f17-4445-baf7-31f5bf0724a1'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:30 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 1073741824" returned: 0 in 0.779s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:30 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 Jul 31 11:11:30 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:30 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.496s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Deleted volume successfully. Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8acedabe-a48e-4c8c-af12-92373a42c6e6 tempest-ProjectReaderTests-309693554 None] Lock "cinder-532a775d-5dfa-4258-82c1-fc25c9fa71a0-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (a9b35086-579c-41cb-9f55-3fb478bb9c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023dcbe-b238-4d61-a76c-94252a812df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023dcbe-b238-4d61-a76c-94252a812df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1605456559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386e0750-85be-45ea-adbc-18f2076c4099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:30Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2374e3-82a5-4583-8a67-88ebffb04691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2374e3-82a5-4583-8a67-88ebffb04691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56917f04-7c60-43ea-94d0-163a1a686f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56917f04-7c60-43ea-94d0-163a1a686f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386e0750-85be-45ea-adbc-18f2076c4099', 'volume_name': 'volume-386e0750-85be-45ea-adbc-18f2076c4099', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae98951-2d4d-490e-9e48-16467df9c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae98951-2d4d-490e-9e48-16467df9c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8faa6971-b11e-4086-9c5a-ad0fffbe84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:30 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Volume 386e0750-85be-45ea-adbc-18f2076c4099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386e0750-85be-45ea-adbc-18f2076c4099', 'volume_size': 1} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:30 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3" returned: 0 in 0.427s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615953049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e282c9-b8e0-4164-836f-ebfdba9fed45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:29Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:30 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Creating volume 61e282c9-b8e0-4164-836f-ebfdba9fed45 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:30 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.456s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:30 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 1073741824 Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a96dfab-7d92-43d9-a6f0-6a3064eb2305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115d7b35-918f-4422-afac-d287c1e2fcf3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:30 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e82fae3-2ae6-4589-869d-ca09a0a53c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:30 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Deleted volume successfully. Jul 31 11:11:30 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Volume volume-115d7b35-918f-4422-afac-d287c1e2fcf3 (115d7b35-918f-4422-afac-d287c1e2fcf3): created successfully Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e82fae3-2ae6-4589-869d-ca09a0a53c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:30 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (6a9c0b3f-04b0-40b8-9ae1-d8f8cbd0dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f1666b15-4fb7-4a19-80e8-037835f4cd07 tempest-CreateVolumesFromSnapshotTest-1667589882 None] Lock "cinder-6c035ff8-1ee4-44f1-9b88-3012576cccc0-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:31 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-245b3f55-014a-4644-97be-eedb9ccb8d12 tempest-CreateVolumesFromImageTest-1230918398 None] Created volume successfully. Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (e8c37da5-23fe-4e26-a604-baf9eedef31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b25a4ff-1f2f-4fb9-810e-0e5e71435cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b25a4ff-1f2f-4fb9-810e-0e5e71435cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424745441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5246b10-48a6-4c21-b362-8fa178ae469b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:31Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21fb424-83d1-47be-b6f8-eee060ec78a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21fb424-83d1-47be-b6f8-eee060ec78a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a83f6e-b30a-4bae-90ff-2ec2bd722b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a83f6e-b30a-4bae-90ff-2ec2bd722b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5246b10-48a6-4c21-b362-8fa178ae469b', 'volume_name': 'volume-c5246b10-48a6-4c21-b362-8fa178ae469b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f2c463-2e4d-40ca-a484-aaead64ecb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f2c463-2e4d-40ca-a484-aaead64ecb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213da7bc-fbb5-44fb-8c2b-23bf1c829372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:31 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Volume c5246b10-48a6-4c21-b362-8fa178ae469b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5246b10-48a6-4c21-b362-8fa178ae469b', 'volume_size': 1} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:31 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 1073741824" returned: 0 in 0.706s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:31 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 Jul 31 11:11:31 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:32 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45" returned: 0 in 0.370s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379021965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:30Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Creating volume 46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:32 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d21e919-4345-4643-8745-549d08f98b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e282c9-b8e0-4164-836f-ebfdba9fed45', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:32 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d 1073741824 Jul 31 11:11:32 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cfb6a1-9b46-4c3c-b265-7f85646ec4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:32 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Volume volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 (61e282c9-b8e0-4164-836f-ebfdba9fed45): created successfully Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cfb6a1-9b46-4c3c-b265-7f85646ec4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (91c5a194-e700-416b-9c06-076d386ec2d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:32 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d40ddd8d-acc4-47e8-99ce-dfc53bcc2426 tempest-CreateVolumesFromImageTest-1230918398 None] Created volume successfully. Jul 31 11:11:32 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d 1073741824" returned: 0 in 0.575s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:32 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d Jul 31 11:11:32 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:32 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d" returned: 0 in 0.311s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1605456559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386e0750-85be-45ea-adbc-18f2076c4099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c51610f64b6248d0b524fc5cf6d19c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:30Z,use_quota=True,user_id='70bb086573a245f091c422fa1e5c150b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Creating volume 386e0750-85be-45ea-adbc-18f2076c4099 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:32 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:32 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd763fd0-eeaf-484a-8da6-bf8c66c7df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1320a82c-e8d1-4787-8ab3-7562cee2b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:33 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 1073741824 Jul 31 11:11:33 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:33 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Volume volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d (46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d): created successfully Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1320a82c-e8d1-4787-8ab3-7562cee2b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (3447d74c-91b8-4f2e-9fe8-0f453d513d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:33 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6a15a7b2-0539-4e65-9eb9-284014fc73ac tempest-CreateVolumesFromImageTest-1230918398 None] Created volume successfully. Jul 31 11:11:33 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 1073741824" returned: 0 in 0.531s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:33 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 Jul 31 11:11:33 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:33 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099" returned: 0 in 0.305s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424745441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5246b10-48a6-4c21-b362-8fa178ae469b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:31Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Creating volume c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:33 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8faa6971-b11e-4086-9c5a-ad0fffbe84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386e0750-85be-45ea-adbc-18f2076c4099', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:33 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b 1073741824 Jul 31 11:11:33 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59bab2c-fc9d-4d43-addc-4a3560a0ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:33 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Volume volume-386e0750-85be-45ea-adbc-18f2076c4099 (386e0750-85be-45ea-adbc-18f2076c4099): created successfully Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59bab2c-fc9d-4d43-addc-4a3560a0ba76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:33 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Flow 'volume_create_manager' (a9b35086-579c-41cb-9f55-3fb478bb9c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:34 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9bb5ef5c-051c-4b61-a1bc-1cdd8ae908d8 tempest-CreateVolumesFromImageTest-1230918398 None] Created volume successfully. Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Flow 'volume_create_manager' (5007343c-04fa-487d-8340-1cbccc6bd6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee524161-4337-44fb-81bb-f78b2bef5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-386e0750-85be-45ea-adbc-18f2076c4099-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee524161-4337-44fb-81bb-f78b2bef5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb2006e-65cd-48ed-832a-392b8cd8e2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb57f4ca084d228dfce5d2b7a45219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:34Z,use_quota=True,user_id='b606bc1726c4454dabda605da552c8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12ced34-a881-4253-8089-a8a5d7966a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12ced34-a881-4253-8089-a8a5d7966a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ba8f73-a146-4f2b-bfba-d19644a2e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ba8f73-a146-4f2b-bfba-d19644a2e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb2006e-65cd-48ed-832a-392b8cd8e2a0', 'volume_name': 'volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e8d7ff-7ae8-4607-afe5-4dbf1448cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e8d7ff-7ae8-4607-afe5-4dbf1448cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e40f1f-977e-4d88-b8e1-f8907fb633fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Volume 9eb2006e-65cd-48ed-832a-392b8cd8e2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0', 'volume_size': 1} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-386e0750-85be-45ea-adbc-18f2076c4099-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-quobyte-386e0750-85be-45ea-adbc-18f2076c4099" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-386e0750-85be-45ea-adbc-18f2076c4099" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f2dbce-31f3-49b0-a20a-572d5fab0d11]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (f6e16240-231e-45db-9b6a-86f8e0e866a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c407f7-2d87-4764-a4f7-aa2d83df1096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b 1073741824" returned: 0 in 0.625s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c407f7-2d87-4764-a4f7-aa2d83df1096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-604179449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90870a8-5d70-44cf-a351-1997ee938b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:34Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a92d128-2499-4035-b386-ec6f981944ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a92d128-2499-4035-b386-ec6f981944ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 Jul 31 11:11:34 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae6012c-252e-471c-9724-6e9944a16b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae6012c-252e-471c-9724-6e9944a16b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90870a8-5d70-44cf-a351-1997ee938b82', 'volume_name': 'volume-a90870a8-5d70-44cf-a351-1997ee938b82', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f180248-b66d-4976-b22d-46bccc705878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f180248-b66d-4976-b22d-46bccc705878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e534d3-d07e-47d8-a412-56032fa3f2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume a90870a8-5d70-44cf-a351-1997ee938b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90870a8-5d70-44cf-a351-1997ee938b82', 'volume_size': 1} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:34 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b Jul 31 11:11:34 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:34 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099" returned: 0 in 0.382s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:34 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099 Jul 31 11:11:34 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:34 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b" returned: 0 in 0.258s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb2006e-65cd-48ed-832a-392b8cd8e2a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb57f4ca084d228dfce5d2b7a45219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:34Z,use_quota=True,user_id='b606bc1726c4454dabda605da552c8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Creating volume 9eb2006e-65cd-48ed-832a-392b8cd8e2a0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:34 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213da7bc-fbb5-44fb-8c2b-23bf1c829372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5246b10-48a6-4c21-b362-8fa178ae469b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7a7ea3-0700-4173-8c3d-19fb82c2a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:34 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 1073741824 Jul 31 11:11:34 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Volume volume-c5246b10-48a6-4c21-b362-8fa178ae469b (c5246b10-48a6-4c21-b362-8fa178ae469b): created successfully Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7a7ea3-0700-4173-8c3d-19fb82c2a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (e8c37da5-23fe-4e26-a604-baf9eedef31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:34 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-71daf051-8807-4eb7-92d1-3f6ac86bf939 tempest-ProjectReaderTests-309693554 None] Created volume successfully. Jul 31 11:11:35 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-386e0750-85be-45ea-adbc-18f2076c4099" returned: 0 in 0.247s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-386e0750-85be-45ea-adbc-18f2076c4099" released by "delete_volume" :: held 0.670s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Created reservations ['35c496ed-5b87-4a9d-a150-c40449665856', '60c70618-1d0a-4452-8bc3-fc4bb34c3781', 'f9bb8366-244a-4a88-8b51-5b4d7bb5c327', '990c7c75-5013-4836-afd5-fa2718179f89'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:35 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:35 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:35 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 1073741824" returned: 0 in 0.473s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:35 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 Jul 31 11:11:35 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:35 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-quobyte-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:35 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Deleted volume successfully. Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d" acquired by "delete_volume" :: waited 0.044s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8c623d7c-606f-4e3c-8ae1-1cba8b2c2726 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-386e0750-85be-45ea-adbc-18f2076c4099-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b21def-3d47-475a-9a40-e28d68447c37]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:35 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d Jul 31 11:11:35 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:35 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0" returned: 0 in 0.357s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-604179449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90870a8-5d70-44cf-a351-1997ee938b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:34Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Creating volume a90870a8-5d70-44cf-a351-1997ee938b82 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:35 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e40f1f-977e-4d88-b8e1-f8907fb633fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:35 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 1073741824 Jul 31 11:11:35 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c12f0aa-67ad-454c-bc04-e73c6f70d7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:35 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Volume volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 (9eb2006e-65cd-48ed-832a-392b8cd8e2a0): created successfully Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c12f0aa-67ad-454c-bc04-e73c6f70d7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Flow 'volume_create_manager' (5007343c-04fa-487d-8340-1cbccc6bd6e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:35 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e1e1448e-01c0-4aba-8922-13809f5559fa tempest-CinderUnicodeTest-183664185 None] Created volume successfully. Jul 31 11:11:35 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d" returned: 0 in 0.358s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:35 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d Jul 31 11:11:35 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:36 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 1073741824" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:36 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d" returned: 0 in 0.270s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d" released by "delete_volume" :: held 0.714s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:36 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 Jul 31 11:11:36 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Created reservations ['bd59c226-160a-468a-ab8b-9e28adef7263', '32450230-7aef-44a4-b078-02d54a348b59', '1a2c0904-7113-4b81-b440-82809967f100', 'deb9d403-9dcd-42e0-9ac9-0500991497cb'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:36 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:36 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:36 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82" returned: 0 in 0.276s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.889s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Creating offline snapshot 960ac29a-3a32-4d6a-aad7-f7f87f72c904 of volume c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e534d3-d07e-47d8-a412-56032fa3f2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90870a8-5d70-44cf-a351-1997ee938b82', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ac2355-b021-4090-8523-fffb06518e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ca7a0-c16a-4d97-bf91-1644aab6d767]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:36 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume volume-a90870a8-5d70-44cf-a351-1997ee938b82 (a90870a8-5d70-44cf-a351-1997ee938b82): created successfully Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ac2355-b021-4090-8523-fffb06518e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (f6e16240-231e-45db-9b6a-86f8e0e866a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-284fb378-dd16-409c-bc64-6cecd2328963 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created volume successfully. Jul 31 11:11:36 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.385s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Deleted volume successfully. Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-61e282c9-b8e0-4164-836f-ebfdba9fed45-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-085d79f3-668c-4da1-ae23-b476ac52de28 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-46b2c9b8-b8b4-40f8-bee8-aa4a957aa50d-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-61e282c9-b8e0-4164-836f-ebfdba9fed45-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:36 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b Jul 31 11:11:36 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-quobyte-61e282c9-b8e0-4164-836f-ebfdba9fed45" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-61e282c9-b8e0-4164-836f-ebfdba9fed45" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac22fc0-60e8-49c6-9b78-40001f14ba05]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:36 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Flow 'volume_create_manager' (19cce3a1-50bc-4ed0-8c4d-6ce968ef9a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaffdd8-2740-4a8d-8b20-a10ff2db00c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaffdd8-2740-4a8d-8b20-a10ff2db00c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-7578432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f6865-8c6f-4c7f-b8c4-b0635f48fae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb57f4ca084d228dfce5d2b7a45219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:37Z,use_quota=True,user_id='b606bc1726c4454dabda605da552c8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c87b826-5eec-495d-9a00-0db810fead50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c87b826-5eec-495d-9a00-0db810fead50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d5e134-5393-429f-bf4a-eb8426304470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d5e134-5393-429f-bf4a-eb8426304470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232f6865-8c6f-4c7f-b8c4-b0635f48fae5', 'volume_name': 'volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc1836f-559d-4e19-8ed3-8514e0b01f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc1836f-559d-4e19-8ed3-8514e0b01f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:37 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 Jul 31 11:11:37 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0972964a-2cc9-4c56-8d0d-796200a4e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Volume 232f6865-8c6f-4c7f-b8c4-b0635f48fae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5', 'volume_size': 1} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:37 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b" returned: 0 in 0.540s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:37 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 1G Jul 31 11:11:37 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45" returned: 0 in 0.381s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:37 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45 Jul 31 11:11:37 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 1G" returned: 0 in 0.374s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5246b10-48a6-4c21-b362-8fa178ae469b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:37 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5246b10-48a6-4c21-b362-8fa178ae469b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 Jul 31 11:11:37 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-61e282c9-b8e0-4164-836f-ebfdba9fed45" returned: 0 in 0.268s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-61e282c9-b8e0-4164-836f-ebfdba9fed45" released by "delete_volume" :: held 0.696s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Created reservations ['9868a7c8-fc22-4b0b-bb49-f18d70cb0e06', '546097c4-d4f4-48eb-8697-6fbac33713ec', 'ba643230-801e-4ebe-a60a-4ebd95dd584b', '21ac2763-b028-4ff7-8a52-606efba0a0fb'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:37 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:37 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:37 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5246b10-48a6-4c21-b362-8fa178ae469b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904" returned: 0 in 0.319s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:37 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 is being set with open permissions: ugo+rw Jul 31 11:11:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:37 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 Jul 31 11:11:37 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-115d7b35-918f-4422-afac-d287c1e2fcf3-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-115d7b35-918f-4422-afac-d287c1e2fcf3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:38 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.343s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-quobyte-115d7b35-918f-4422-afac-d287c1e2fcf3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:38 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Deleted volume successfully. Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-115d7b35-918f-4422-afac-d287c1e2fcf3" acquired by "delete_volume" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-506a1ed9-6067-4aa3-8220-1562be3bb64b tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-61e282c9-b8e0-4164-836f-ebfdba9fed45-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[564d068a-aa09-43da-8956-c92de41cda58]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904" returned: 0 in 0.366s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info Jul 31 11:11:38 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 Jul 31 11:11:38 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (ac012f89-7806-4515-841c-386958c07d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0c3d5e-a757-461d-b669-7f87210a8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0c3d5e-a757-461d-b669-7f87210a8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39709530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e21a28b-83b0-4ed7-be37-67b0db1659a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:38Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbf490f-950c-4324-9522-af1edc4674bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbf490f-950c-4324-9522-af1edc4674bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a421117-3465-4c4e-a57c-3b8f641560a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a421117-3465-4c4e-a57c-3b8f641560a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e21a28b-83b0-4ed7-be37-67b0db1659a5', 'volume_name': 'volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87911dce-79ab-4b5b-a12f-43b5312140a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87911dce-79ab-4b5b-a12f-43b5312140a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b887b8-e2a5-407c-a811-032eb90dba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume 4e21a28b-83b0-4ed7-be37-67b0db1659a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5', 'volume_size': 1} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:38 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info is being set with open permissions: ugo+rw Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info Jul 31 11:11:38 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3" returned: 0 in 0.475s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:38 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3 Jul 31 11:11:38 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (9407dbdf-6ca1-4f98-9327-07d068f5cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e77e863-be60-4692-96f4-b5db4c467ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e77e863-be60-4692-96f4-b5db4c467ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17752708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b03f41-cd40-4bb8-9f23-dd32ae6c7431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:39Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbee922-ed55-4d21-a80a-5d4ac9f889b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbee922-ed55-4d21-a80a-5d4ac9f889b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d064e630-6a41-44d9-bfd4-0bf69a70e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d064e630-6a41-44d9-bfd4-0bf69a70e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b03f41-cd40-4bb8-9f23-dd32ae6c7431', 'volume_name': 'volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d35988-e5e7-496a-af31-d8dc4d6ecbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d35988-e5e7-496a-af31-d8dc4d6ecbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f79877-6099-452d-90f6-39fbb4a1944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:38 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume 89b03f41-cd40-4bb8-9f23-dd32ae6c7431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431', 'volume_size': 1} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:38 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.info" returned: 0 in 0.385s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-7578432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f6865-8c6f-4c7f-b8c4-b0635f48fae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb57f4ca084d228dfce5d2b7a45219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:37Z,use_quota=True,user_id='b606bc1726c4454dabda605da552c8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Creating volume 232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:38 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-115d7b35-918f-4422-afac-d287c1e2fcf3" returned: 0 in 0.378s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:39 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 1073741824 Jul 31 11:11:39 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-115d7b35-918f-4422-afac-d287c1e2fcf3" released by "delete_volume" :: held 0.920s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b3db42ca-e831-47ef-b6a5-4d3ac12a161b tempest-ProjectReaderTests-309693554 None] Create snapshot completed successfully Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Created reservations ['d899de6e-5314-4fbe-8dbb-3b413bd040f9', '3037b196-ed67-4f9d-8f69-48ce8a7963cd', '7797aeff-0917-4a66-8342-600c25e773da', '8ac86563-7eb1-4ade-a026-1dc65ee28003'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (da0346f4-37ad-43f4-899d-ff58d3eb4feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9666fe-2195-4355-bbb0-7d2c0ab7f9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9666fe-2195-4355-bbb0-7d2c0ab7f9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482024517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c130899a-954d-4930-b5c1-b215aeb6f286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:39Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:39 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439a4b42-0f85-40aa-9a6c-db4867f410b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439a4b42-0f85-40aa-9a6c-db4867f410b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c7c4b-512e-4c6b-a8de-3a70644f37d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885c7c4b-512e-4c6b-a8de-3a70644f37d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c130899a-954d-4930-b5c1-b215aeb6f286', 'volume_name': 'volume-c130899a-954d-4930-b5c1-b215aeb6f286', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1073d80f-f69d-4b8f-aed0-1847ae33f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1073d80f-f69d-4b8f-aed0-1847ae33f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0b2fe0-648b-4956-b292-ead6f1832df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume c130899a-954d-4930-b5c1-b215aeb6f286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c130899a-954d-4930-b5c1-b215aeb6f286', 'volume_size': 1} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:39 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 1073741824" returned: 0 in 0.529s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:39 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.322s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Deleted volume successfully. Jul 31 11:11:39 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 Jul 31 11:11:39 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (c3aea95c-1c99-45b0-b45d-da666337d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8cc023-b039-43f3-8d83-d1db0462cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5ea92281-140d-4880-b767-a4c6d359a1f8 tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-115d7b35-918f-4422-afac-d287c1e2fcf3-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8cc023-b039-43f3-8d83-d1db0462cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441398081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30678bfe-f4ec-4d48-9a2b-084c9ed247a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:40Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e2f2a7-e901-47cc-b7ef-ed6b041643a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e2f2a7-e901-47cc-b7ef-ed6b041643a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf490c9-e0d0-4816-9383-a0562c4e874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf490c9-e0d0-4816-9383-a0562c4e874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30678bfe-f4ec-4d48-9a2b-084c9ed247a2', 'volume_name': 'volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfc5bf7-5a92-4bf6-a054-e44610bfa06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfc5bf7-5a92-4bf6-a054-e44610bfa06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ec3118-2844-42c5-932d-ca231133acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume 30678bfe-f4ec-4d48-9a2b-084c9ed247a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2', 'volume_size': 1} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:39 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" returned: 0 in 0.286s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39709530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e21a28b-83b0-4ed7-be37-67b0db1659a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:38Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Creating volume 4e21a28b-83b0-4ed7-be37-67b0db1659a5 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0972964a-2cc9-4c56-8d0d-796200a4e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 1073741824 Jul 31 11:11:39 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53d9720-6682-4fdc-826a-85f6b7c81e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Volume volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 (232f6865-8c6f-4c7f-b8c4-b0635f48fae5): created successfully Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a53d9720-6682-4fdc-826a-85f6b7c81e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Flow 'volume_create_manager' (19cce3a1-50bc-4ed0-8c4d-6ce968ef9a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3a8e582c-4371-4d33-a17c-daaf41d6d309 tempest-CinderUnicodeTest-183664185 None] Created volume successfully. Jul 31 11:11:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-960ac29a-3a32-4d6a-aad7-f7f87f72c904-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Lock "cinder-960ac29a-3a32-4d6a-aad7-f7f87f72c904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-c5246b10-48a6-4c21-b362-8fa178ae469b" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-c5246b10-48a6-4c21-b362-8fa178ae469b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-960ac29a-3a32-4d6a-aad7-f7f87f72c904" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (27395722-e2c0-44eb-b2a5-45b5f653e176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb7b4aa-6250-44c7-b553-9d27c1de7bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-960ac29a-3a32-4d6a-aad7-f7f87f72c904" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Deleting offline snapshot 960ac29a-3a32-4d6a-aad7-f7f87f72c904 of volume c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] snapshot_file for this snap is: volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb7b4aa-6250-44c7-b553-9d27c1de7bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644126001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6337b768-f1da-4436-a62d-330419727372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:40Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1ca4a3-cefb-41f1-b6b4-b9f0f31cec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1ca4a3-cefb-41f1-b6b4-b9f0f31cec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe52360-6c8b-4fed-84b3-29717c9ce6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe52360-6c8b-4fed-84b3-29717c9ce6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6337b768-f1da-4436-a62d-330419727372', 'volume_name': 'volume-6337b768-f1da-4436-a62d-330419727372', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3534197d-89e2-463f-9f2f-1ffb1a956d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3534197d-89e2-463f-9f2f-1ffb1a956d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77b2f1f-f727-4fad-a32a-1645f7f6644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume 6337b768-f1da-4436-a62d-330419727372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6337b768-f1da-4436-a62d-330419727372', 'volume_size': 1} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cf8367-ee3d-4e2d-b328-7c6e7aab6b14]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 Jul 31 11:11:40 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-82af529b-c754-48bb-8739-284b70ffbbf3-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-82af529b-c754-48bb-8739-284b70ffbbf3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "cinder-quobyte-82af529b-c754-48bb-8739-284b70ffbbf3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 1073741824" returned: 0 in 0.560s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-82af529b-c754-48bb-8739-284b70ffbbf3" acquired by "delete_volume" :: waited 0.041s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884791a-cc30-4f80-a4e7-9cd8909c743a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:40 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 Jul 31 11:11:40 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904" returned: 0 in 0.443s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5246b10-48a6-4c21-b362-8fa178ae469b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:40 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 Jul 31 11:11:40 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52995e-6a94-4147-bf86-ee84b7b83299]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5" returned: 0 in 0.264s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.935s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17752708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b03f41-cd40-4bb8-9f23-dd32ae6c7431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:39Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Creating volume 89b03f41-cd40-4bb8-9f23-dd32ae6c7431 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:40 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b Jul 31 11:11:40 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 1073741824 Jul 31 11:11:40 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b887b8-e2a5-407c-a811-032eb90dba9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ba6483-ad15-4c57-883d-f9bedce082e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:40 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 (4e21a28b-83b0-4ed7-be37-67b0db1659a5): created successfully Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ba6483-ad15-4c57-883d-f9bedce082e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (ac012f89-7806-4515-841c-386958c07d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:40 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-241efadb-1175-4c3d-b055-3837d7ce5e69 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created volume successfully. Jul 31 11:11:40 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3" returned: 0 in 0.426s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:40 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3 Jul 31 11:11:40 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b" returned: 0 in 0.441s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:41 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 Jul 31 11:11:41 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-82af529b-c754-48bb-8739-284b70ffbbf3" returned: 0 in 0.269s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-quobyte-82af529b-c754-48bb-8739-284b70ffbbf3" released by "delete_volume" :: held 0.753s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:41 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 1073741824" returned: 0 in 0.458s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Created reservations ['6a28224e-7e91-4b43-9d7c-6dcebcbf3319', '5a3ee5bc-cf54-4ff3-b9a6-12d7aea849ba', '3495adfa-a664-4f1c-8d12-eee51147fc0c', 'e5006fcb-4c54-4ee1-825c-da166fe8c415'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:41 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 Jul 31 11:11:41 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:41 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:41 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904" returned: 0 in 0.385s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:41 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904 Jul 31 11:11:41 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431" returned: 0 in 0.294s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482024517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c130899a-954d-4930-b5c1-b215aeb6f286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:39Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Creating volume c130899a-954d-4930-b5c1-b215aeb6f286 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:41 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:41 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 1073741824 Jul 31 11:11:41 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f79877-6099-452d-90f6-39fbb4a1944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dc6e08-02c5-48db-bb2b-065bb179fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:41 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 (89b03f41-cd40-4bb8-9f23-dd32ae6c7431): created successfully Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dc6e08-02c5-48db-bb2b-065bb179fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:41 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (9407dbdf-6ca1-4f98-9327-07d068f5cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.340s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Deleted volume successfully. Jul 31 11:11:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4de69d49-90bf-4570-95df-355880c52605 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created volume successfully. Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ae8b832f-0335-42c4-8434-01660b8ef25e tempest-CreateVolumesFromImageTest-1230918398 None] Lock "cinder-82af529b-c754-48bb-8739-284b70ffbbf3-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:41 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b.960ac29a-3a32-4d6a-aad7-f7f87f72c904" returned: 0 in 0.357s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-960ac29a-3a32-4d6a-aad7-f7f87f72c904" released by "_delete_snapshot" :: held 1.773s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-c5246b10-48a6-4c21-b362-8fa178ae469b" released by "delete_snapshot" :: held 1.851s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Created reservations ['015bf1d9-005d-4ab0-b910-f02cb4eac774', 'deb552fd-6900-4ee8-9d9b-c2c399ff901a', '52823420-53f2-4a33-b9f1-72db14b06646', '30498212-8eab-444b-80c0-4c820eae997f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Delete snapshot completed successfully. Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ab60b62b-c86d-41b2-8a81-4e913302b1eb tempest-ProjectReaderTests-309693554 None] Lock "cinder-960ac29a-3a32-4d6a-aad7-f7f87f72c904-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:42 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 1073741824" returned: 0 in 0.520s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-c5246b10-48a6-4c21-b362-8fa178ae469b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:42 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 Jul 31 11:11:42 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Lock "cinder-c5246b10-48a6-4c21-b362-8fa178ae469b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-c5246b10-48a6-4c21-b362-8fa178ae469b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-c5246b10-48a6-4c21-b362-8fa178ae469b" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e935a4ec-606f-437e-b221-2f71d3e4a9ea]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:42 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:42 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b Jul 31 11:11:42 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.717s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441398081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30678bfe-f4ec-4d48-9a2b-084c9ed247a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:40Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Creating volume 30678bfe-f4ec-4d48-9a2b-084c9ed247a2 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:42 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0b2fe0-648b-4956-b292-ead6f1832df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c130899a-954d-4930-b5c1-b215aeb6f286', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 1073741824 Jul 31 11:11:42 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617b386-25aa-4714-83bd-0968fe4f7e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:42 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume volume-c130899a-954d-4930-b5c1-b215aeb6f286 (c130899a-954d-4930-b5c1-b215aeb6f286): created successfully Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b617b386-25aa-4714-83bd-0968fe4f7e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (da0346f4-37ad-43f4-899d-ff58d3eb4feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4eb5a153-828d-4686-8bb7-d002fb1c3a63 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created volume successfully. Jul 31 11:11:42 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b" returned: 0 in 0.441s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:42 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b Jul 31 11:11:42 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:42 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 1073741824" returned: 0 in 0.526s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:43 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c5246b10-48a6-4c21-b362-8fa178ae469b" returned: 0 in 0.306s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:43 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 Jul 31 11:11:43 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-c5246b10-48a6-4c21-b362-8fa178ae469b" released by "delete_volume" :: held 0.844s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Created reservations ['d5c40f18-fd2b-4177-8a83-b4f509fb5b60', '6055c6c0-f03c-4713-88f4-3bb83fec8b48', '25440178-1604-4532-aa2e-d6b06169ce54', '43ae8300-7732-4103-becd-0c80ab4f0984'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:43 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:43 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:43 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2" returned: 0 in 0.309s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.185s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1644126001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6337b768-f1da-4436-a62d-330419727372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4023fd6e6a774646abd15903b4f976bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:40Z,use_quota=True,user_id='04eb91b23112488fa13c1acd6661e5b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Creating volume 6337b768-f1da-4436-a62d-330419727372 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:43 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ec3118-2844-42c5-932d-ca231133acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352dadf9-dead-40d8-876c-d0197d650ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:43 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 1073741824 Jul 31 11:11:43 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:43 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 (30678bfe-f4ec-4d48-9a2b-084c9ed247a2): created successfully Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352dadf9-dead-40d8-876c-d0197d650ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (c3aea95c-1c99-45b0-b45d-da666337d6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-245dc7e5-879c-4af7-87a6-e49d33654d1d tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created volume successfully. Jul 31 11:11:43 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.340s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Deleted volume successfully. Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-00a2c6d0-b93c-47d6-b699-31e3394cf6c2 tempest-ProjectReaderTests-309693554 None] Lock "cinder-c5246b10-48a6-4c21-b362-8fa178ae469b-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (23cd61b9-3b1d-4487-8358-cc0e277ac0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1b6da8-4a90-45de-a8cd-d2df6f8ffcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:43 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1b6da8-4a90-45de-a8cd-d2df6f8ffcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316741149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:44Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ab201c-1d13-4ae6-b373-a7a220b8e1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ab201c-1d13-4ae6-b373-a7a220b8e1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09b7f99-c4fe-41c7-a2f2-aef93af955d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09b7f99-c4fe-41c7-a2f2-aef93af955d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6', 'volume_name': 'volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:43 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9946d8de-dbe5-4e5b-81a8-c87615720278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9946d8de-dbe5-4e5b-81a8-c87615720278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7380287-fb87-4fac-acad-85bb2377ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Volume d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6', 'volume_size': 1} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 1073741824" returned: 0 in 0.625s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:44 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 Jul 31 11:11:44 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:44 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372" returned: 0 in 0.260s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.785s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77b2f1f-f727-4fad-a32a-1645f7f6644e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6337b768-f1da-4436-a62d-330419727372', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e454c8-52dd-4b1b-83d8-532f3d5c5168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Creating offline snapshot 1e19f478-bb7c-4b66-93ec-4904063aaab2 of volume 232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:44 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Volume volume-6337b768-f1da-4436-a62d-330419727372 (6337b768-f1da-4436-a62d-330419727372): created successfully Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e454c8-52dd-4b1b-83d8-532f3d5c5168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Flow 'volume_create_manager' (27395722-e2c0-44eb-b2a5-45b5f653e176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef77ebcd-8025-4a1b-8f41-794b60ae81e0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:44 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-81fb2e9f-e473-4781-b63f-5f2c3d8b7d77 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created volume successfully. Jul 31 11:11:44 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 Jul 31 11:11:44 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-6337b768-f1da-4436-a62d-330419727372-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-6337b768-f1da-4436-a62d-330419727372-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-quobyte-6337b768-f1da-4436-a62d-330419727372" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-6337b768-f1da-4436-a62d-330419727372" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7801006-064d-444d-81a6-4d40a3c5210f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:44 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:44 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 1G Jul 31 11:11:44 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:44 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 Jul 31 11:11:44 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372" returned: 0 in 0.432s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:45 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372 Jul 31 11:11:45 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 1G" returned: 0 in 0.449s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:45 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 Jul 31 11:11:45 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-6337b768-f1da-4436-a62d-330419727372" returned: 0 in 0.245s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-6337b768-f1da-4436-a62d-330419727372" released by "delete_volume" :: held 0.722s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created reservations ['b1983709-0d50-40f1-9f7b-fde0239d0e44', 'fad1617d-f887-44ea-bdb0-4a419c8a20c3', 'ecb550b2-d4ac-4b90-a96c-e302429ba805', '7bf447a4-a7d5-4a9e-8c69-347e4d82b30e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:45 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2" returned: 0 in 0.293s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 is being set with open permissions: ugo+rw Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:45 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:45 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 Jul 31 11:11:45 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.253s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Deleted volume successfully. Jul 31 11:11:45 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-30678bfe-f4ec-4d48-9a2b-084c9ed247a2-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2" returned: 0 in 0.269s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bbf65b33-af41-4fc9-822c-e97df5b4f6f9 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-6337b768-f1da-4436-a62d-330419727372-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-30678bfe-f4ec-4d48-9a2b-084c9ed247a2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:45 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info Jul 31 11:11:45 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-quobyte-30678bfe-f4ec-4d48-9a2b-084c9ed247a2" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-30678bfe-f4ec-4d48-9a2b-084c9ed247a2" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a45bced-b323-4334-a56a-aca15feb2d56]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:46 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 Jul 31 11:11:46 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:46 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info" returned: 0 in 0.259s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:46 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info is being set with open permissions: ugo+rw Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:46 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info Jul 31 11:11:46 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:46 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2" returned: 0 in 0.386s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:46 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2 Jul 31 11:11:46 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:46 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.info" returned: 0 in 0.307s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.439s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316741149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:44Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Creating volume d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:46 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:46 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 1073741824 Jul 31 11:11:46 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:46 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-702ef436-eab8-4269-97cc-204ead9a0092 tempest-CinderUnicodeTest-183664185 None] Create snapshot completed successfully Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:46 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-30678bfe-f4ec-4d48-9a2b-084c9ed247a2" returned: 0 in 0.290s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:46 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:46 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-30678bfe-f4ec-4d48-9a2b-084c9ed247a2" released by "delete_volume" :: held 0.729s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created reservations ['79928ad8-bf01-4e4d-8b32-b539a25ef90c', '2b00a087-0119-4fb2-9e1a-42c6dd35b44f', '8e2c3611-5777-4d59-8a37-799abdcb7d29', 'fc9bf00d-745c-42ef-b71a-4c32b3483e94'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:46 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:46 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:46 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.362s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-1e19f478-bb7c-4b66-93ec-4904063aaab2-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:11:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-1e19f478-bb7c-4b66-93ec-4904063aaab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-quobyte-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-quobyte-1e19f478-bb7c-4b66-93ec-4904063aaab2" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-1e19f478-bb7c-4b66-93ec-4904063aaab2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Deleting offline snapshot 1e19f478-bb7c-4b66-93ec-4904063aaab2 of volume 232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] snapshot_file for this snap is: volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-c130899a-954d-4930-b5c1-b215aeb6f286-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:47 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[094be137-e375-43e3-8602-957fad9a95f2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 1073741824" returned: 0 in 0.716s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-c130899a-954d-4930-b5c1-b215aeb6f286-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:47 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.435s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Deleted volume successfully. Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-quobyte-c130899a-954d-4930-b5c1-b215aeb6f286" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-833ce644-79c1-48ad-a10f-1969e7cebb90 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-30678bfe-f4ec-4d48-9a2b-084c9ed247a2-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:47 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 Jul 31 11:11:47 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-c130899a-954d-4930-b5c1-b215aeb6f286" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:47 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 Jul 31 11:11:47 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ab573-b866-4866-a50e-54cd306dec64]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 Jul 31 11:11:47 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" returned: 0 in 0.260s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7380287-fb87-4fac-acad-85bb2377ac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09b4278-d8c5-4392-891b-828d842ed027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Volume volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 (d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6): created successfully Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09b4278-d8c5-4392-891b-828d842ed027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:47 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (23cd61b9-3b1d-4487-8358-cc0e277ac0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2" returned: 0 in 0.433s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-118f369b-debd-4d97-a163-2691c93abfa2 tempest-ProjectReaderTests-309693554 None] Created volume successfully. Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e335bc6-e5df-4670-956a-db90159fccae]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286" returned: 0 in 0.393s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:47 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 Jul 31 11:11:47 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286 Jul 31 11:11:47 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:47 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-c130899a-954d-4930-b5c1-b215aeb6f286" returned: 0 in 0.254s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:47 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-c130899a-954d-4930-b5c1-b215aeb6f286" released by "delete_volume" :: held 0.693s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:48 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:48 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 Jul 31 11:11:48 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created reservations ['1b35b6ca-69f0-4407-b53c-f55a12e5bf6f', 'ed5df3c4-b7e0-4162-820e-9d1d7b574c5d', '073368f7-faf9-419e-a909-ab2336bee164', '2789e1eb-04d4-40ca-97f7-8d793db9ff92'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:48 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:48 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:48 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2" returned: 0 in 0.512s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Creating offline snapshot 6b238ad9-6026-4d61-9dd7-f7789b25cb4a of volume d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:48 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.331s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:48 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2 Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:48 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:48 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Deleted volume successfully. Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a70f9d-6bf5-4db2-a9ad-91e22e859706]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8f261b74-0bdf-4647-9505-f87663982bfb tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-c130899a-954d-4930-b5c1-b215aeb6f286-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-89b03f41-cd40-4bb8-9f23-dd32ae6c7431-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:48 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 Jul 31 11:11:48 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-89b03f41-cd40-4bb8-9f23-dd32ae6c7431-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-quobyte-89b03f41-cd40-4bb8-9f23-dd32ae6c7431" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:48 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-89b03f41-cd40-4bb8-9f23-dd32ae6c7431" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5.1e19f478-bb7c-4b66-93ec-4904063aaab2" returned: 0 in 0.337s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[57588c5b-7ee9-4818-9273-3412ba185983]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-1e19f478-bb7c-4b66-93ec-4904063aaab2" released by "_delete_snapshot" :: held 1.823s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:48 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" released by "delete_snapshot" :: held 1.866s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Created reservations ['0d06dbbf-c579-48c8-8ade-e70849590de1', '2bdeb348-6434-4ab1-ae95-dc09a2657d93', '82e6b3bc-ed8c-4a84-9f9c-61d01f0c433d', '81422f55-d89b-4547-958c-ef44bdaa06bc'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:49 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 Jul 31 11:11:49 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:49 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Delete snapshot completed successfully. Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" returned: 0 in 0.516s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2c9e0159-01f8-4387-984c-6ef8e4e9263a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-1e19f478-bb7c-4b66-93ec-4904063aaab2-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:49 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a 1G Jul 31 11:11:49 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-232f6865-8c6f-4c7f-b8c4-b0635f48fae5-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-232f6865-8c6f-4c7f-b8c4-b0635f48fae5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-quobyte-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:49 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431" returned: 0 in 0.489s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a0050-fc17-4cd2-ad34-a5d206c926c2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:49 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431 Jul 31 11:11:49 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 Jul 31 11:11:49 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a 1G" returned: 0 in 0.513s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:49 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-89b03f41-cd40-4bb8-9f23-dd32ae6c7431" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:49 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a Jul 31 11:11:49 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-89b03f41-cd40-4bb8-9f23-dd32ae6c7431" released by "delete_volume" :: held 0.829s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created reservations ['20743b93-25af-4e70-bb73-0322a0d2327b', '16049c38-d9ec-4c56-b5e5-2bb059dfca31', '1abb5514-310b-4404-9ff2-4966646189bd', '32b1002f-025c-4adb-a82a-38ccb494e315'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:49 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:49 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5 Jul 31 11:11:49 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:49 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:49 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-4e21a28b-83b0-4ed7-be37-67b0db1659a5-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-4e21a28b-83b0-4ed7-be37-67b0db1659a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:49 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-quobyte-4e21a28b-83b0-4ed7-be37-67b0db1659a5" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:50 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a" returned: 0 in 0.384s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a is being set with open permissions: ugo+rw Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-4e21a28b-83b0-4ed7-be37-67b0db1659a5" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:50 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a Jul 31 11:11:50 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed114a6-e1f0-4eac-b7d4-b80a60ff1083]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" returned: 0 in 0.322s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.287s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-232f6865-8c6f-4c7f-b8c4-b0635f48fae5" released by "delete_volume" :: held 0.787s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Deleted volume successfully. Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bcc794bd-12ca-4697-85c4-73c14654ea43 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-89b03f41-cd40-4bb8-9f23-dd32ae6c7431-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:50 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 Jul 31 11:11:50 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Created reservations ['7e210fac-ed85-4b8c-ae64-8a21e6475249', '5a52db43-61f6-486d-b41b-717428542ec0', '7770d90a-8dbd-4bbc-9ddf-291b2112340a', '175aed31-940e-4fb4-bee5-34e4b41d354e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:50 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a" returned: 0 in 0.351s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info Jul 31 11:11:50 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-9eb2006e-65cd-48ed-832a-392b8cd8e2a0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Lock "cinder-9eb2006e-65cd-48ed-832a-392b8cd8e2a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:50 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5" returned: 0 in 0.525s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5 Jul 31 11:11:50 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Acquiring lock "cinder-quobyte-9eb2006e-65cd-48ed-832a-392b8cd8e2a0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-9eb2006e-65cd-48ed-832a-392b8cd8e2a0" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11aa18e-29ee-4096-af77-07ff924c549a]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.481s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Deleted volume successfully. Jul 31 11:11:50 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-9ed4dba3-5052-495f-9c15-daaf1025400a tempest-CinderUnicodeTest-183664185 None] Lock "cinder-232f6865-8c6f-4c7f-b8c4-b0635f48fae5-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info" returned: 0 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info is being set with open permissions: ugo+rw Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:50 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info Jul 31 11:11:50 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 Jul 31 11:11:50 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:50 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-4e21a28b-83b0-4ed7-be37-67b0db1659a5" returned: 0 in 0.308s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-4e21a28b-83b0-4ed7-be37-67b0db1659a5" released by "delete_volume" :: held 0.884s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:50 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created reservations ['87e95f27-588b-47d1-9f73-acfd312b8085', '3a332950-3fc6-474f-a69a-5fbac7a44594', 'be9ab8de-c636-4d28-a3aa-cab39c0ff308', '212aacad-c1df-4fb6-8d2b-ff94b0c38800'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:51 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:51 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-a90870a8-5d70-44cf-a351-1997ee938b82-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-a90870a8-5d70-44cf-a351-1997ee938b82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:51 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0" returned: 0 in 0.522s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:51 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:51 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0 Jul 31 11:11:51 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.info" returned: 0 in 0.445s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "cinder-quobyte-a90870a8-5d70-44cf-a351-1997ee938b82" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-a90870a8-5d70-44cf-a351-1997ee938b82" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f8bc51ac-2deb-4781-8065-e2a22fe06fdf tempest-ProjectReaderTests-309693554 None] Create snapshot completed successfully Jul 31 11:11:51 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.349s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8faef9-490f-42e2-b27c-a645cb081498]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:51 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Deleted volume successfully. Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ef95466e-1fa4-48d5-8587-cff76b0599b2 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-4e21a28b-83b0-4ed7-be37-67b0db1659a5-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:51 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-9eb2006e-65cd-48ed-832a-392b8cd8e2a0" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Lock "cinder-quobyte-9eb2006e-65cd-48ed-832a-392b8cd8e2a0" released by "delete_volume" :: held 0.868s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:51 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 Jul 31 11:11:51 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Created reservations ['6007f924-7e7e-469b-804e-8e1e88dc4361', '9af1366a-8811-4690-adaf-e298f64cfbd0', '0d4ce622-f4d8-4552-b578-35a5f39dc4dd', 'd38edcc4-af6c-4807-bcbe-dee79ca7a4d9'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:51 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:51 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-6b238ad9-6026-4d61-9dd7-f7789b25cb4a-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Lock "cinder-6b238ad9-6026-4d61-9dd7-f7789b25cb4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-6b238ad9-6026-4d61-9dd7-f7789b25cb4a" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-6b238ad9-6026-4d61-9dd7-f7789b25cb4a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Deleting offline snapshot 6b238ad9-6026-4d61-9dd7-f7789b25cb4a of volume d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] snapshot_file for this snap is: volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ca092c-9e21-4588-8bae-245baa4f70f7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:51 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82" returned: 0 in 0.521s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:51 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82 Jul 31 11:11:51 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:52 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Deleted volume successfully. Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-48834687-f962-4676-95ee-22d1a6c62ea1 tempest-CinderUnicodeTest-183664185 None] Lock "cinder-9eb2006e-65cd-48ed-832a-392b8cd8e2a0-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:52 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a Jul 31 11:11:52 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:52 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a90870a8-5d70-44cf-a351-1997ee938b82" returned: 0 in 0.298s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-quobyte-a90870a8-5d70-44cf-a351-1997ee938b82" released by "delete_volume" :: held 0.881s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Created reservations ['e1809ed5-115d-496e-ac52-04cc623c7060', '153e0698-e8a2-43be-8955-dd8938c75311', '91b1cb27-0818-4ba0-b297-34bebc041dcc', '8c708984-f870-4930-9f42-8feb5ad8045c'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:52 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a" returned: 0 in 0.483s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3760dbf-c7e6-4262-bc5d-9685f31e1207]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:52 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:52 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:52 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 Jul 31 11:11:52 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:52 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.271s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:52 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Deleted volume successfully. Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-38857eab-f2ac-4d26-a680-80a4c9c88e09 tempest-CreateVolumesFromSourceVolumeTest-1658269030 None] Lock "cinder-a90870a8-5d70-44cf-a351-1997ee938b82-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:52 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" returned: 0 in 0.412s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:52 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a Jul 31 11:11:52 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:53 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a" returned: 0 in 0.387s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:53 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a Jul 31 11:11:53 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:53 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6.6b238ad9-6026-4d61-9dd7-f7789b25cb4a" returned: 0 in 0.265s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-6b238ad9-6026-4d61-9dd7-f7789b25cb4a" released by "_delete_snapshot" :: held 1.673s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" released by "delete_snapshot" :: held 1.710s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Created reservations ['f33f72d6-cc42-4ac7-a4f3-35508e3e056e', 'e37290a9-5da9-44d9-a10c-84315ac74b1f', '739500c5-94f4-4d66-845d-6796cc8e76d4', 'de6b5393-bdab-4125-b841-cbe8a16b23b3'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Delete snapshot completed successfully. Jul 31 11:11:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-98cb9e99-2cab-473c-8603-801ae4ba43b8 tempest-ProjectReaderTests-309693554 None] Lock "cinder-6b238ad9-6026-4d61-9dd7-f7789b25cb4a-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Lock "cinder-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac96dffd-2d53-4157-a8db-ef4b0b1f4b2d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:54 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 Jul 31 11:11:54 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:54 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" returned: 0 in 0.552s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:54 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6 Jul 31 11:11:54 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:55 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" returned: 0 in 0.376s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6" released by "delete_volume" :: held 1.025s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Created reservations ['67cf931a-22eb-4b04-80ac-b8301b824a60', '7a9d702a-40c9-408b-adf1-fd3956ce3a60', 'e2afd681-5d32-459b-b47b-a19ac70e378e', '4f597971-f85c-4f2b-8477-8e83dc2cdd94'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:55 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:11:55 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:55 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.313s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:11:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Deleted volume successfully. Jul 31 11:11:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-73ba5065-9094-459b-afdc-7a3cc93f0a65 tempest-ProjectReaderTests-309693554 None] Lock "cinder-d8a95f49-6d52-4ac4-a9f1-3b1cfb3255e6-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (355bb40b-4e2c-4d4e-8e21-bb01d125f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ff1cb7-5688-4141-a803-4b43810e7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ff1cb7-5688-4141-a803-4b43810e7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373169248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d23a597-4a94-4778-ab3d-8e15494c1255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:57Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd198976-6a4d-4ff8-b411-d278a5e6ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd198976-6a4d-4ff8-b411-d278a5e6ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd179f51-9a67-4e40-9f38-52a80663e8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd179f51-9a67-4e40-9f38-52a80663e8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d23a597-4a94-4778-ab3d-8e15494c1255', 'volume_name': 'volume-3d23a597-4a94-4778-ab3d-8e15494c1255', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e45107b-58d9-4cd3-a9d6-6903feae23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e45107b-58d9-4cd3-a9d6-6903feae23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b058bfd1-5441-4a26-9e4b-eb01b5e428b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Volume 3d23a597-4a94-4778-ab3d-8e15494c1255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d23a597-4a94-4778-ab3d-8e15494c1255', 'volume_size': 1} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373169248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d23a597-4a94-4778-ab3d-8e15494c1255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:57Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Creating volume 3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:56 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:57 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 1073741824 Jul 31 11:11:57 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:57 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 1073741824" returned: 0 in 0.802s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (bc37d699-c5cc-43da-879e-114649b7e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba0aa82-fd1b-4dab-ba88-817e75a49b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba0aa82-fd1b-4dab-ba88-817e75a49b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561057898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d420c2-0580-4223-af8d-8d8331f0efb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:58Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30613102-bbcf-4bd9-9d6d-7dfd5783a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30613102-bbcf-4bd9-9d6d-7dfd5783a72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b15178-067d-482f-acea-cba966ff31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b15178-067d-482f-acea-cba966ff31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d420c2-0580-4223-af8d-8d8331f0efb4', 'volume_name': 'volume-29d420c2-0580-4223-af8d-8d8331f0efb4', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79d2773-dd84-46bf-a863-173ca05cc33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79d2773-dd84-46bf-a863-173ca05cc33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de36653-39a2-419d-b817-8e4cf273ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:57 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Volume 29d420c2-0580-4223-af8d-8d8331f0efb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d420c2-0580-4223-af8d-8d8331f0efb4', 'volume_size': 1} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:57 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 Jul 31 11:11:57 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:58 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255" returned: 0 in 0.355s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561057898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d420c2-0580-4223-af8d-8d8331f0efb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:11:58Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Creating volume 29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:11:58 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b058bfd1-5441-4a26-9e4b-eb01b5e428b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d23a597-4a94-4778-ab3d-8e15494c1255', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf44989-2225-4e79-bca8-c26d9649df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:58 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 1073741824 Jul 31 11:11:58 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:58 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Volume volume-3d23a597-4a94-4778-ab3d-8e15494c1255 (3d23a597-4a94-4778-ab3d-8e15494c1255): created successfully Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf44989-2225-4e79-bca8-c26d9649df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (355bb40b-4e2c-4d4e-8e21-bb01d125f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0f10d726-4efc-4e8a-8d2e-8b21215e7894 tempest-ProjectReaderTests-309693554 None] Created volume successfully. Jul 31 11:11:58 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 1073741824" returned: 0 in 0.581s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=333,cinder:SELECT=232,cinder:INSERT=77,cinder:DELETE=23 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:11:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:58 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 Jul 31 11:11:58 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=237,cinder:UPDATE=312,cinder:DELETE=34,cinder:INSERT=89 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:11:59 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.059s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de36653-39a2-419d-b817-8e4cf273ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d420c2-0580-4223-af8d-8d8331f0efb4', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcc3ed5-6667-4c90-9d5b-05a89c240490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Creating offline snapshot eba5089a-7b42-4a5a-85ce-a288386f604b of volume 3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:11:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Volume volume-29d420c2-0580-4223-af8d-8d8331f0efb4 (29d420c2-0580-4223-af8d-8d8331f0efb4): created successfully Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcc3ed5-6667-4c90-9d5b-05a89c240490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (bc37d699-c5cc-43da-879e-114649b7e27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea1d7e-1eee-4001-a882-2efc63db3338]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0a585cf3-589c-4271-a384-c58e89f20f17 tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:11:59 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 Jul 31 11:11:59 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:11:59 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255" returned: 0 in 0.418s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:11:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:11:59 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b 1G Jul 31 11:11:59 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:00 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b 1G" returned: 0 in 0.711s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d23a597-4a94-4778-ab3d-8e15494c1255 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:00 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d23a597-4a94-4778-ab3d-8e15494c1255 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b Jul 31 11:12:00 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:00 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d23a597-4a94-4778-ab3d-8e15494c1255 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b" returned: 0 in 0.424s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:00 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b is being set with open permissions: ugo+rw Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:00 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b Jul 31 11:12:00 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Flow 'volume_create_manager' (3d91c068-5f24-4189-a80e-092633ac660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:00 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3efd89-7cbc-4fff-8f15-cfc0324bbdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3efd89-7cbc-4fff-8f15-cfc0324bbdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611d184a-37ec-473e-bf5a-ee0c2206fddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945a910fd5b84a8fba0ac87af64bcda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:01Z,use_quota=True,user_id='29a596cc13ed4db9bffcac35fe712525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776417b0-8007-49f3-825a-8172d9f26096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776417b0-8007-49f3-825a-8172d9f26096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f544bc53-c627-4d39-98e8-7bcf33a01dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.image.glance [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Creating Keystone auth plugin from conf {{(pid=88837) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 31 11:12:01 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:01 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info Jul 31 11:12:01 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f544bc53-c627-4d39-98e8-7bcf33a01dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '611d184a-37ec-473e-bf5a-ee0c2206fddb', 'volume_name': 'volume-611d184a-37ec-473e-bf5a-ee0c2206fddb', 'volume_size': 1, 'image_id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a1a9bb87ce6049e22dec68af2049258', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '945a910fd5b84a8fba0ac87af64bcda0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '011a56425106528c439fe5208f8ce5a9fb87a7d5ae88efad2310b17da075b8311cd12874965b13bc1c355f9af58414ae7776c6b211bfb64ae9741c894bc74e8e', 'id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'created_at': datetime.datetime(2026, 7, 31, 9, 11, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6/file', 'properties': {}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eebff61-a16e-46b3-8c92-43d358b59e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eebff61-a16e-46b3-8c92-43d358b59e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc62bd01-4fa9-49ef-9181-a3f08d962b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:01 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Volume 611d184a-37ec-473e-bf5a-ee0c2206fddb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-611d184a-37ec-473e-bf5a-ee0c2206fddb', 'volume_size': 1, 'image_id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a1a9bb87ce6049e22dec68af2049258', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '945a910fd5b84a8fba0ac87af64bcda0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '011a56425106528c439fe5208f8ce5a9fb87a7d5ae88efad2310b17da075b8311cd12874965b13bc1c355f9af58414ae7776c6b211bfb64ae9741c894bc74e8e', 'id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'created_at': datetime.datetime(2026, 7, 31, 9, 11, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6/file', 'properties': {}}, 'image_service': } Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Trying to clone 611d184a-37ec-473e-bf5a-ee0c2206fddb from image ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'metadata': {}}]). {{(pid=88837) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 31 11:12:01 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Image download 0.00 MB at 0.00 MB/s Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[938156c9-aba7-4d1d-a9b6-04c0ac27a784]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:01 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info" returned: 0 in 0.350s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:01 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info is being set with open permissions: ugo+rw Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:01 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD Jul 31 11:12:01 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:01 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info Jul 31 11:12:01 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:01 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:01 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.info" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.429s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 709b65e7-2d15-49eb-8f6d-ab2d71df899f of volume 29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fbbdf58f-e333-46fa-afd3-38f85692b089 tempest-ProjectReaderTests-309693554 None] Create snapshot completed successfully Jul 31 11:12:01 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD Jul 31 11:12:01 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:01 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9593ba4-515e-4e09-a652-4b573f59244f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:02 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 Jul 31 11:12:02 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:02 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Temporary image ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 is fetched for user 29a596cc13ed4db9bffcac35fe712525. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f68c952-a1df-4d90-b79f-8cfcb93b2b24]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:02 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:02 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f 1G Jul 31 11:12:02 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:02 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD Jul 31 11:12:02 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:02 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-eba5089a-7b42-4a5a-85ce-a288386f604b-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Lock "cinder-eba5089a-7b42-4a5a-85ce-a288386f604b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-3d23a597-4a94-4778-ab3d-8e15494c1255" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-3d23a597-4a94-4778-ab3d-8e15494c1255" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-eba5089a-7b42-4a5a-85ce-a288386f604b" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-eba5089a-7b42-4a5a-85ce-a288386f604b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Deleting offline snapshot eba5089a-7b42-4a5a-85ce-a288386f604b of volume 3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] snapshot_file for this snap is: volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b53eb57-e6c5-425f-9b64-43bdd1d98c61]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:02 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD Jul 31 11:12:02 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:03 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b Jul 31 11:12:03 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:03 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f 1G" returned: 0 in 0.726s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d420c2-0580-4223-af8d-8d8331f0efb4 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:03 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d420c2-0580-4223-af8d-8d8331f0efb4 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f Jul 31 11:12:03 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:03 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:03 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b" returned: 0 in 0.453s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d23a597-4a94-4778-ab3d-8e15494c1255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf6fcb7-62aa-4003-b881-aa8fdf473054]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:03 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d420c2-0580-4223-af8d-8d8331f0efb4 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f" returned: 0 in 0.346s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:03 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f is being set with open permissions: ugo+rw Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:03 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f Jul 31 11:12:03 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:03 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 Jul 31 11:12:03 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:03 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:03 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info Jul 31 11:12:03 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:03 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255" returned: 0 in 0.441s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:03 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b Jul 31 11:12:03 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:04 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info" returned: 0 in 0.305s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:04 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info is being set with open permissions: ugo+rw Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:04 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info Jul 31 11:12:04 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:04 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b" returned: 0 in 0.406s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:04 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b Jul 31 11:12:04 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:04 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.info" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611d184a-37ec-473e-bf5a-ee0c2206fddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945a910fd5b84a8fba0ac87af64bcda0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:01Z,use_quota=True,user_id='29a596cc13ed4db9bffcac35fe712525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Creating volume 611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:04 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:04 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb 1073741824 Jul 31 11:12:04 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-41354a02-f1b7-4441-a997-4db945953b37 tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:12:04 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255.eba5089a-7b42-4a5a-85ce-a288386f604b" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-eba5089a-7b42-4a5a-85ce-a288386f604b" released by "_delete_snapshot" :: held 1.745s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-3d23a597-4a94-4778-ab3d-8e15494c1255" released by "delete_snapshot" :: held 1.774s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Created reservations ['55acc60c-885d-4d03-bba6-dfb8675620c7', '2c479159-bc02-4524-be91-febd127a50cf', '3799d49a-199d-42f1-9bbd-22ad0459786e', 'e5b563bb-cd1a-4df0-b079-8e5b9cf804b3'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-709b65e7-2d15-49eb-8f6d-ab2d71df899f-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Lock "cinder-709b65e7-2d15-49eb-8f6d-ab2d71df899f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-29d420c2-0580-4223-af8d-8d8331f0efb4" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-29d420c2-0580-4223-af8d-8d8331f0efb4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-709b65e7-2d15-49eb-8f6d-ab2d71df899f" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-709b65e7-2d15-49eb-8f6d-ab2d71df899f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 709b65e7-2d15-49eb-8f6d-ab2d71df899f of volume 29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad9fa8-36de-4c6e-8026-b9b8701bfc44]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Delete snapshot completed successfully. Jul 31 11:12:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-79b5a798-d399-4024-95f7-3393f901198a tempest-ProjectReaderTests-309693554 None] Lock "cinder-eba5089a-7b42-4a5a-85ce-a288386f604b-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:05 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb 1073741824" returned: 0 in 0.593s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-3d23a597-4a94-4778-ab3d-8e15494c1255-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:05 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f Jul 31 11:12:05 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Lock "cinder-3d23a597-4a94-4778-ab3d-8e15494c1255-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:05 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:05 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-3d23a597-4a94-4778-ab3d-8e15494c1255" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-3d23a597-4a94-4778-ab3d-8e15494c1255" acquired by "delete_volume" :: waited 0.032s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd478b-34a8-45e2-8f93-aab8a6ac1718]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:05 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 0 in 0.298s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:05 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f" returned: 0 in 0.554s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29d420c2-0580-4223-af8d-8d8331f0efb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:05 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 Jul 31 11:12:05 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c743f-17e4-45f0-8197-da22c4b4ee80]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Attempting download of ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'metadata': {}}])) to volume 611d184a-37ec-473e-bf5a-ee0c2206fddb. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[53be8073-cb24-4424-b3c9-e2d29a0d871f]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:05 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 Jul 31 11:12:05 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:05 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l Jul 31 11:12:05 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:05 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255" returned: 0 in 0.468s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:05 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255 Jul 31 11:12:05 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:05 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l" returned: 0 in 0.409s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:05 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4" returned: 0 in 0.528s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:06 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f Jul 31 11:12:06 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:06 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l Jul 31 11:12:06 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:06 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-3d23a597-4a94-4778-ab3d-8e15494c1255" returned: 0 in 0.368s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-3d23a597-4a94-4778-ab3d-8e15494c1255" released by "delete_volume" :: held 0.928s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Created reservations ['9fbd1e7e-a8b8-442c-82d0-1e21f0e72172', 'a4b0340b-64d2-4543-8f6e-204ccaa5a91d', '17ba36c0-447b-4a03-b778-7b3a823901a5', '4f3afd66-7432-4c49-9ccf-759532f6a3e5'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:06 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:06 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:06 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l" returned: 1 in 0.498s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_4bl3922l' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a852e-25bb-4e23-8887-50598e5bbf88]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:06 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f" returned: 0 in 0.487s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:06 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f Jul 31 11:12:06 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:06 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD Jul 31 11:12:06 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:06 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Deleted volume successfully. Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-51488529-d933-4d6e-a166-438d4a7844f9 tempest-ProjectReaderTests-309693554 None] Lock "cinder-3d23a597-4a94-4778-ab3d-8e15494c1255-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:06 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4.709b65e7-2d15-49eb-8f6d-ab2d71df899f" returned: 0 in 0.315s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-709b65e7-2d15-49eb-8f6d-ab2d71df899f" released by "_delete_snapshot" :: held 2.025s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:06 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-29d420c2-0580-4223-af8d-8d8331f0efb4" released by "delete_snapshot" :: held 2.080s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:06 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Created reservations ['c2fc0dc2-9da2-47d0-bc61-50fab7315545', '55491453-d595-465b-828e-3ecc2bdef165', '893042b0-91c2-4605-83d1-692f94759553', 'f8689b77-42eb-4683-a38f-f69c91a3a1a9'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:06 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD Jul 31 11:12:06 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-36bb2ef8-d8ca-49e9-adfe-6f8681428238 tempest-ProjectMemberTests-164003752 None] Lock "cinder-709b65e7-2d15-49eb-8f6d-ab2d71df899f-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:07 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 was raw, converting to raw {{(pid=88837) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:07 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:07 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:07 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 0 in 0.371s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab815da1-ab7d-4d7f-863b-90f7a5a5afb6_g65zu8rbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:12:07 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Converted 0.00 MB image at 0.00 MB/s Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:07 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb 1G Jul 31 11:12:07 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (bdcfb24d-dd0c-4cdb-9b89-861ed0a1e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159cf01b-24da-4219-8b91-8f15201dff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159cf01b-24da-4219-8b91-8f15201dff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962647254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a7e15-bfa3-4a61-8454-799e4177318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:08Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15607d83-1dec-4c18-85c7-faef60141186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15607d83-1dec-4c18-85c7-faef60141186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab278c79-7774-40a6-bf1f-075d4105e2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab278c79-7774-40a6-bf1f-075d4105e2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26a7e15-bfa3-4a61-8454-799e4177318a', 'volume_name': 'volume-a26a7e15-bfa3-4a61-8454-799e4177318a', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bd843f-2c1f-4cd7-aeb8-0bba768b5aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80bd843f-2c1f-4cd7-aeb8-0bba768b5aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4698bc2-163b-4fee-ba95-59e82e431767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Volume a26a7e15-bfa3-4a61-8454-799e4177318a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26a7e15-bfa3-4a61-8454-799e4177318a', 'volume_size': 1} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-962647254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a7e15-bfa3-4a61-8454-799e4177318a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549658fdde2c48289c49acc00370a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:08Z,use_quota=True,user_id='c88578c70eb345ddbe7b39809ff4b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Creating volume a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:07 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:07 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-29d420c2-0580-4223-af8d-8d8331f0efb4-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:08 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a 1073741824 Jul 31 11:12:08 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb 1G" returned: 0 in 0.378s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Lock "cinder-29d420c2-0580-4223-af8d-8d8331f0efb4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-29d420c2-0580-4223-af8d-8d8331f0efb4" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[38430d62-3089-4282-a1fe-be935bbfba69]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-29d420c2-0580-4223-af8d-8d8331f0efb4" acquired by "delete_volume" :: waited 0.038s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[852a8374-137e-41e5-966d-4ba4ca095473]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:08 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:08 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:08 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 Jul 31 11:12:08 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:08 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 0 in 0.410s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:08 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a 1073741824" returned: 0 in 0.560s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:08 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a Jul 31 11:12:08 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:08 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:08 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:08 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4" returned: 0 in 0.476s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:08 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4 Jul 31 11:12:08 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:08 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a" returned: 0 in 0.338s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4698bc2-163b-4fee-ba95-59e82e431767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26a7e15-bfa3-4a61-8454-799e4177318a', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9534e3ad-2e72-4629-ac54-c8b2ab794afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:08 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29d420c2-0580-4223-af8d-8d8331f0efb4" returned: 0 in 0.300s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:08 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Volume volume-a26a7e15-bfa3-4a61-8454-799e4177318a (a26a7e15-bfa3-4a61-8454-799e4177318a): created successfully Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9534e3ad-2e72-4629-ac54-c8b2ab794afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Flow 'volume_create_manager' (bdcfb24d-dd0c-4cdb-9b89-861ed0a1e64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-29d420c2-0580-4223-af8d-8d8331f0efb4" released by "delete_volume" :: held 0.867s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:08 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-917cbbb3-d3f1-4d0e-b4f0-7241ee779207 tempest-ProjectReaderTests-309693554 None] Created volume successfully. Jul 31 11:12:09 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 1 in 0.494s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Downloaded image ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'metadata': {}}])) to volume 611d184a-37ec-473e-bf5a-ee0c2206fddb successfully. {{(pid=88837) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Temporary image ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 for user 29a596cc13ed4db9bffcac35fe712525 is deleted. {{(pid=88837) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.volume_utils [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Marking volume 611d184a-37ec-473e-bf5a-ee0c2206fddb as bootable. {{(pid=88837) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Copying metadata from image ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 to 611d184a-37ec-473e-bf5a-ee0c2206fddb. {{(pid=88837) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Creating volume glance metadata for volume 611d184a-37ec-473e-bf5a-ee0c2206fddb backed by image ab815da1-ab7d-4d7f-863b-90f7a5a5afb6 with: {'image_id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5a1a9bb87ce6049e22dec68af2049258', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88837) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Created reservations ['f3da0a0e-45fe-4183-8122-79c8364908e8', '45181708-fb24-44e5-bda7-5dbdbfaac308', 'a6f1888d-90d5-47b4-b551-524b16d2cb11', '8dd1a0b0-c571-4d5e-9253-ad970d9e5402'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc62bd01-4fa9-49ef-9181-a3f08d962b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611d184a-37ec-473e-bf5a-ee0c2206fddb', 'volume_size': 1, 'image_id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a1a9bb87ce6049e22dec68af2049258', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '945a910fd5b84a8fba0ac87af64bcda0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '011a56425106528c439fe5208f8ce5a9fb87a7d5ae88efad2310b17da075b8311cd12874965b13bc1c355f9af58414ae7776c6b211bfb64ae9741c894bc74e8e', 'id': 'ab815da1-ab7d-4d7f-863b-90f7a5a5afb6', 'created_at': datetime.datetime(2026, 7, 31, 9, 11, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 31, 9, 11, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab815da1-ab7d-4d7f-863b-90f7a5a5afb6/file', 'properties': {}}, 'image_service': }' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9152487-9770-4997-8444-75e4035b7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Volume volume-611d184a-37ec-473e-bf5a-ee0c2206fddb (611d184a-37ec-473e-bf5a-ee0c2206fddb): created successfully Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9152487-9770-4997-8444-75e4035b7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Flow 'volume_create_manager' (3d91c068-5f24-4189-a80e-092633ac660d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-12008af1-86c0-4a71-a849-8fd3eab24e39 tempest-VolumeImageDependencyTests-1466460892 None] Created volume successfully. Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:09 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:09 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:09 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-ba6b1207-b6ac-43b8-9a7d-e56d8116584c tempest-ProjectMemberTests-164003752 None] Lock "cinder-29d420c2-0580-4223-af8d-8d8331f0efb4-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Acquiring lock "cinder-611d184a-37ec-473e-bf5a-ee0c2206fddb-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (5172659e-931f-4849-8b81-7474f768ee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee463ba-3021-4a14-a62a-4ac1184b6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Lock "cinder-611d184a-37ec-473e-bf5a-ee0c2206fddb-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee463ba-3021-4a14-a62a-4ac1184b6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191113107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578ef05d-6494-41bd-9df3-9301b7248943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:10Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8378ba-66fe-4688-8241-86e98ababa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8378ba-66fe-4688-8241-86e98ababa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceeb831-7a4e-4d43-8870-17298fa147c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceeb831-7a4e-4d43-8870-17298fa147c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578ef05d-6494-41bd-9df3-9301b7248943', 'volume_name': 'volume-578ef05d-6494-41bd-9df3-9301b7248943', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a940ba-431e-4db5-9bff-73f1c7edc4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a940ba-431e-4db5-9bff-73f1c7edc4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8015a5f-83bd-4f47-a0b5-e3b577f1963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:09 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Volume 578ef05d-6494-41bd-9df3-9301b7248943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578ef05d-6494-41bd-9df3-9301b7248943', 'volume_size': 1} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191113107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578ef05d-6494-41bd-9df3-9301b7248943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:10Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Creating volume 578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:09 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:09 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 1073741824 Jul 31 11:12:09 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Acquiring lock "cinder-quobyte-611d184a-37ec-473e-bf5a-ee0c2206fddb" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Lock "cinder-quobyte-611d184a-37ec-473e-bf5a-ee0c2206fddb" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68d778-c337-43f1-91ac-fc7412b6099d]: (4, 'raw') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:10 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:10 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:10 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 1073741824" returned: 0 in 0.526s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:10 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 Jul 31 11:12:10 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:10 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 0 in 0.496s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:10 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:10 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:10 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943" returned: 0 in 0.338s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.647s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8015a5f-83bd-4f47-a0b5-e3b577f1963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578ef05d-6494-41bd-9df3-9301b7248943', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9dd63a-64d0-4aea-bc2e-cebd108cbedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Creating offline snapshot fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd of volume a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:10 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Volume volume-578ef05d-6494-41bd-9df3-9301b7248943 (578ef05d-6494-41bd-9df3-9301b7248943): created successfully Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9dd63a-64d0-4aea-bc2e-cebd108cbedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (5172659e-931f-4849-8b81-7474f768ee5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d4855e-184c-4d81-8d53-1b8305a876c8]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:10 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f69d02c9-7641-4fe8-b069-6c448f5c9ea8 tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:12:10 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a Jul 31 11:12:10 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:10 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 1 in 0.490s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb' failed. Not Retrying. {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:11 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb Jul 31 11:12:11 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:11 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-611d184a-37ec-473e-bf5a-ee0c2206fddb" returned: 0 in 0.281s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:11 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a" returned: 0 in 0.433s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Lock "cinder-quobyte-611d184a-37ec-473e-bf5a-ee0c2206fddb" released by "delete_volume" :: held 1.375s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:11 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd 1G Jul 31 11:12:11 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Created reservations ['2120faf2-ef8a-408c-8257-b1ef4eeefa28', '8858c687-cf53-4b46-b761-ab6bc142e4b7', '9b8c784b-b0bc-4b1e-a4c3-467fd8f08673', '8852d042-f984-407a-add0-bff69e7e311f'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:11 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:11 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:11 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.495s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:11 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd 1G" returned: 0 in 0.667s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26a7e15-bfa3-4a61-8454-799e4177318a -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Deleted volume successfully. Jul 31 11:12:12 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26a7e15-bfa3-4a61-8454-799e4177318a -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd Jul 31 11:12:12 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:12 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-f9b73108-5a6e-4599-9489-cca27c5f923e tempest-VolumeImageDependencyTests-1466460892 None] Lock "cinder-611d184a-37ec-473e-bf5a-ee0c2206fddb-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:12 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26a7e15-bfa3-4a61-8454-799e4177318a -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" returned: 0 in 0.471s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:12 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd is being set with open permissions: ugo+rw Jul 31 11:12:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:12 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd Jul 31 11:12:12 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:12 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" returned: 0 in 0.301s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:12 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info Jul 31 11:12:12 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:13 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info" returned: 0 in 0.287s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:13 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info is being set with open permissions: ugo+rw Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:13 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info Jul 31 11:12:13 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:13 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.info" returned: 0 in 0.353s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.254s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 221f6eec-ef40-4d84-a59c-0d771c1cec07 of volume 578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:13 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-585e13c3-4171-4e52-8101-f587dbc831fc tempest-ProjectReaderTests-309693554 None] Create snapshot completed successfully Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88fc2f9-99d7-4eb2-8588-e99213512b20]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:13 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 Jul 31 11:12:13 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:13 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943" returned: 0 in 0.471s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:14 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 1G Jul 31 11:12:14 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Lock "cinder-fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-a26a7e15-bfa3-4a61-8454-799e4177318a" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-a26a7e15-bfa3-4a61-8454-799e4177318a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Deleting offline snapshot fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd of volume a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:14 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] snapshot_file for this snap is: volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 1G" returned: 0 in 0.630s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-578ef05d-6494-41bd-9df3-9301b7248943 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[602b8f5a-e36e-4643-9ae5-6aba6ba80e61]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:14 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-578ef05d-6494-41bd-9df3-9301b7248943 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 Jul 31 11:12:14 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:14 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd Jul 31 11:12:14 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:14 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-578ef05d-6494-41bd-9df3-9301b7248943 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07" returned: 0 in 0.369s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:14 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 is being set with open permissions: ugo+rw Jul 31 11:12:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:15 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 Jul 31 11:12:15 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:15 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" returned: 0 in 0.492s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26a7e15-bfa3-4a61-8454-799e4177318a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572aa99-cb0b-48ef-9091-0ce7fafe735b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:15 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:15 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a Jul 31 11:12:15 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:15 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info Jul 31 11:12:15 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:15 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info" returned: 0 in 0.342s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:15 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info is being set with open permissions: ugo+rw Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:15 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a" returned: 0 in 0.523s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:15 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info Jul 31 11:12:15 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:15 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd Jul 31 11:12:15 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:15 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.info" returned: 0 in 0.314s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b90888b5-ad04-4de5-90ae-666d0f953fd5 tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:12:16 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" returned: 0 in 0.593s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:16 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd Jul 31 11:12:16 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-221f6eec-ef40-4d84-a59c-0d771c1cec07-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Lock "cinder-221f6eec-ef40-4d84-a59c-0d771c1cec07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-578ef05d-6494-41bd-9df3-9301b7248943" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-578ef05d-6494-41bd-9df3-9301b7248943" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-221f6eec-ef40-4d84-a59c-0d771c1cec07" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-221f6eec-ef40-4d84-a59c-0d771c1cec07" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 221f6eec-ef40-4d84-a59c-0d771c1cec07 of volume 578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e60097-d4d4-46da-9209-531048ade277]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:16 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a.fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" returned: 0 in 0.419s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd" released by "_delete_snapshot" :: held 2.170s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-a26a7e15-bfa3-4a61-8454-799e4177318a" released by "delete_snapshot" :: held 2.207s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:16 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-e7625000-723b-45e3-8148-b337aca0a944 tempest-ProjectAdminTests-1094778835 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5441589355469, 'free_capacity_gb': 1775.5441589355469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88837) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 31 11:12:16 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Created reservations ['b6cbd8b3-7995-4c1c-8628-c069fb30e5a0', 'b21324f8-8755-4b8c-bd31-c619e2dec9b3', 'e1a70303-762d-4981-89fd-f597870b69e8', '6d299a84-428a-4626-8d53-b70db66edb61'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Delete snapshot completed successfully. Jul 31 11:12:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-28b55d47-de20-4019-9d8f-ab3163ea7fdf tempest-ProjectReaderTests-309693554 None] Lock "cinder-fe4eb0e6-b82d-46ac-b3c0-4cc95fd661cd-delete_snapshot" released by "delete_snapshot" :: held 2.466s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:17 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07" returned: 0 in 0.525s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-578ef05d-6494-41bd-9df3-9301b7248943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1410b5c4-76c5-4591-8a44-eda1219ad361]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:17 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 Jul 31 11:12:17 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:17 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943" returned: 0 in 0.435s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:17 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 Jul 31 11:12:17 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-a26a7e15-bfa3-4a61-8454-799e4177318a-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Lock "cinder-a26a7e15-bfa3-4a61-8454-799e4177318a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Acquiring lock "cinder-quobyte-a26a7e15-bfa3-4a61-8454-799e4177318a" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-a26a7e15-bfa3-4a61-8454-799e4177318a" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a367ac-b9f3-4cd0-9db1-7c543643b77c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:18 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07" returned: 0 in 0.509s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:18 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07 Jul 31 11:12:18 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:18 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a Jul 31 11:12:18 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:18 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943.221f6eec-ef40-4d84-a59c-0d771c1cec07" returned: 0 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:18 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a" returned: 0 in 0.557s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-221f6eec-ef40-4d84-a59c-0d771c1cec07" released by "_delete_snapshot" :: held 2.066s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-578ef05d-6494-41bd-9df3-9301b7248943" released by "delete_snapshot" :: held 2.108s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:18 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a Jul 31 11:12:18 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Created reservations ['948f89a6-39ee-4e3d-a835-2e0303656068', '5bf93941-8425-4d23-8d39-b9f6ca5c41ea', '48f1d3bd-8bb0-4ff7-836d-2541ac7eea6d', 'ca81d5a4-1f38-4344-9afe-89ad9f61ba28'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:12:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-fbdb275e-9776-4b59-bcd4-bfb79dd4e99f tempest-ProjectMemberTests-164003752 None] Lock "cinder-221f6eec-ef40-4d84-a59c-0d771c1cec07-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:19 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-a26a7e15-bfa3-4a61-8454-799e4177318a" returned: 0 in 0.421s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Lock "cinder-quobyte-a26a7e15-bfa3-4a61-8454-799e4177318a" released by "delete_volume" :: held 1.062s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Created reservations ['761e1245-c7be-4295-9088-ff5c007d23af', 'ef24a573-9a69-4988-a57a-0a91529940c4', 'b6cc1c39-9f67-4d04-b9ff-e4a8ec264908', '89e1b895-4a02-4fde-b390-7967eb16176b'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:19 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:19 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:19 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.279s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Deleted volume successfully. Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c0671e2f-a923-460a-af57-f37a8dbc5561 tempest-ProjectReaderTests-309693554 None] Lock "cinder-a26a7e15-bfa3-4a61-8454-799e4177318a-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-578ef05d-6494-41bd-9df3-9301b7248943-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Lock "cinder-578ef05d-6494-41bd-9df3-9301b7248943-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-578ef05d-6494-41bd-9df3-9301b7248943" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-578ef05d-6494-41bd-9df3-9301b7248943" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7877396-55fb-4b36-a546-b882939fef75]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:20 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 Jul 31 11:12:20 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:20 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943" returned: 0 in 0.563s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:20 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943 Jul 31 11:12:20 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Flow 'volume_create_manager' (48fce97e-0418-4ce8-a109-43898aa3c931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667c49e6-7bb0-4f65-a5e4-29dd5dca1e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667c49e6-7bb0-4f65-a5e4-29dd5dca1e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1904846976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065b0ead55a44ec2a613a7fce8a2e2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:21Z,use_quota=True,user_id='d2a4ed4fc1764841ab00d4f83216aecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc7fe71-8021-45a5-a79e-b0b6f59c1ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc7fe71-8021-45a5-a79e-b0b6f59c1ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d174a825-74b0-4c11-b4b7-7628c849e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d174a825-74b0-4c11-b4b7-7628c849e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9', 'volume_name': 'volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ad5799-3be9-4d7e-91be-a37aa8065789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ad5799-3be9-4d7e-91be-a37aa8065789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117d94b-c068-4528-9e33-5896baafc178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:20 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Volume 8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9', 'volume_size': 1} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1904846976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065b0ead55a44ec2a613a7fce8a2e2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:21Z,use_quota=True,user_id='d2a4ed4fc1764841ab00d4f83216aecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Creating volume 8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:20 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:20 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-578ef05d-6494-41bd-9df3-9301b7248943" returned: 0 in 0.339s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:20 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 1073741824 Jul 31 11:12:20 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-578ef05d-6494-41bd-9df3-9301b7248943" released by "delete_volume" :: held 0.991s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:20 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Created reservations ['dc80e262-2dcc-4afe-811f-0ed5a8e1d27c', '608cda51-dbb8-4a33-b5dd-341b432b39b8', 'f215b92b-dc64-4120-8f6c-36d85f0c97af', '17211b3e-8fa0-4079-a3c8-94bcb28a9519'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:21 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:21 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:21 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-2276548a-090c-4cb7-8ee2-7aa4815c8628 tempest-ProjectMemberTests-164003752 None] Lock "cinder-578ef05d-6494-41bd-9df3-9301b7248943-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:21 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 1073741824" returned: 0 in 0.569s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:21 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:21 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:21 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.300s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3117d94b-c068-4528-9e33-5896baafc178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17610cb-ab66-4d85-8907-b5468a29bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:21 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Volume volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 (8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9): created successfully Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17610cb-ab66-4d85-8907-b5468a29bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:21 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Flow 'volume_create_manager' (48fce97e-0418-4ce8-a109-43898aa3c931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-763dd2ff-2222-43ed-a75a-f9d14f3e6a97 tempest-SnapshotDependencyTests-1688397891 None] Created volume successfully. Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (81db2b2b-38fb-4b75-805e-a57c843fe01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e4312b-2a6f-4a01-b201-8c2653858b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e4312b-2a6f-4a01-b201-8c2653858b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61303131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d545b6c-12e8-41d3-bb16-2a00ddcc3707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:23Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203f322a-7e40-4ad9-8d49-15dfa2ed03ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203f322a-7e40-4ad9-8d49-15dfa2ed03ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bade8a5-cbc7-4bb3-b0c2-4b7efd4b7e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bade8a5-cbc7-4bb3-b0c2-4b7efd4b7e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d545b6c-12e8-41d3-bb16-2a00ddcc3707', 'volume_name': 'volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15f2a84-9ac4-43e1-a39b-33f9be02e30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15f2a84-9ac4-43e1-a39b-33f9be02e30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a953f449-f50b-4b38-b36e-f57985b148ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:22 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Volume 8d545b6c-12e8-41d3-bb16-2a00ddcc3707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707', 'volume_size': 1} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61303131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d545b6c-12e8-41d3-bb16-2a00ddcc3707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:23Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Creating volume 8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:22 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:22 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 1073741824 Jul 31 11:12:22 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:23 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 1073741824" returned: 0 in 0.624s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:23 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 Jul 31 11:12:23 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:23 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.521s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Creating offline snapshot 74edb334-0455-4850-94df-32a197f0134f of volume 8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a953f449-f50b-4b38-b36e-f57985b148ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fae709-d2f2-4b4a-872b-e8b416bb588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547bbbe-1e77-4d17-aba1-a4a8baeb2c7f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:23 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Volume volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 (8d545b6c-12e8-41d3-bb16-2a00ddcc3707): created successfully Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fae709-d2f2-4b4a-872b-e8b416bb588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:23 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (81db2b2b-38fb-4b75-805e-a57c843fe01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d522633b-be20-46b9-b2da-afef58799b64 tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:12:23 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:23 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:24 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.506s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:24 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f 1G Jul 31 11:12:24 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:24 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f 1G" returned: 0 in 0.602s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:24 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f Jul 31 11:12:24 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:25 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f" returned: 0 in 0.497s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:25 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f is being set with open permissions: ugo+rw Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:25 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f Jul 31 11:12:25 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Flow 'volume_create_manager' (c115994e-be36-48cd-ac8b-b18df16f7aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a18f7bb-6f8b-496e-952b-397659e8349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a18f7bb-6f8b-496e-952b-397659e8349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898837658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09a4bdf-0192-4070-8d62-02e392cf6463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f0950dcd204144bb857396f25a5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:25Z,use_quota=True,user_id='4659fdf60f0b4f598b8f2ac75e1c919c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2859f121-9fc5-4e0f-ac28-2cccddfdad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2859f121-9fc5-4e0f-ac28-2cccddfdad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcd1bf7-e796-40ce-a52a-abc154cee937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dcd1bf7-e796-40ce-a52a-abc154cee937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09a4bdf-0192-4070-8d62-02e392cf6463', 'volume_name': 'volume-f09a4bdf-0192-4070-8d62-02e392cf6463', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38195788-2367-48fd-9abb-a8a0c06dbfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38195788-2367-48fd-9abb-a8a0c06dbfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ab534-b5e7-45df-873f-083468dfe6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:25 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Volume f09a4bdf-0192-4070-8d62-02e392cf6463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09a4bdf-0192-4070-8d62-02e392cf6463', 'volume_size': 1} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:25 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:25 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info Jul 31 11:12:25 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:25 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info" returned: 0 in 0.259s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:25 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info is being set with open permissions: ugo+rw Jul 31 11:12:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:25 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info Jul 31 11:12:25 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:26 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.info" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.206s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Creating offline snapshot eb915539-ecbf-4459-8526-ed89399e8ea9 of volume 8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:26 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-2e4033ed-57d7-40dd-9948-2074c8e4f5b0 tempest-SnapshotDependencyTests-1688397891 None] Create snapshot completed successfully Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d4bf5-4511-44dd-93bd-f50aba61b0bd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:26 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 Jul 31 11:12:26 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:26 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" returned: 0 in 0.404s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:26 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:26 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 1G Jul 31 11:12:26 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:27 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 1G" returned: 0 in 0.433s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:27 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 Jul 31 11:12:27 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:27 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9" returned: 0 in 0.349s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:27 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 is being set with open permissions: ugo+rw Jul 31 11:12:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:27 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 Jul 31 11:12:27 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:27 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9" returned: 0 in 0.265s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:27 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:27 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info Jul 31 11:12:27 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Flow 'volume_create_manager' (6f616479-bc82-4237-bd40-e3ccf180307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:28 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ca2202-7cca-46be-b8db-749b62e00a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:28 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info" returned: 0 in 0.324s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:28 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info is being set with open permissions: ugo+rw Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ca2202-7cca-46be-b8db-749b62e00a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ae5b4b-6c9f-4225-a1c5-95d04a061a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065b0ead55a44ec2a613a7fce8a2e2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74edb334-0455-4850-94df-32a197f0134f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:28Z,use_quota=True,user_id='d2a4ed4fc1764841ab00d4f83216aecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d78498-5ea3-4a2e-abca-71a96bab5932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d78498-5ea3-4a2e-abca-71a96bab5932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9263c3a9-f3aa-4ea0-ad52-6b42c066f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9263c3a9-f3aa-4ea0-ad52-6b42c066f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29ae5b4b-6c9f-4225-a1c5-95d04a061a1f', 'volume_name': 'volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f', 'volume_size': 1, 'snapshot_id': '74edb334-0455-4850-94df-32a197f0134f'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:28 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebd850b-7768-452c-97bb-4ef86d753103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebd850b-7768-452c-97bb-4ef86d753103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097a28c6-5a70-498a-bfef-2428dd63abdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:28 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Volume 29ae5b4b-6c9f-4225-a1c5-95d04a061a1f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f', 'volume_size': 1, 'snapshot_id': '74edb334-0455-4850-94df-32a197f0134f'} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:28 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.info" returned: 0 in 0.301s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.855s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898837658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09a4bdf-0192-4070-8d62-02e392cf6463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f0950dcd204144bb857396f25a5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:25Z,use_quota=True,user_id='4659fdf60f0b4f598b8f2ac75e1c919c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Creating volume f09a4bdf-0192-4070-8d62-02e392cf6463 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:28 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:28 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 1073741824 Jul 31 11:12:28 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:28 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0e47f553-d2c0-45f0-bfe3-2fd0917cc84a tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:12:28 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 1073741824" returned: 0 in 0.448s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:28 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:28 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 Jul 31 11:12:28 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:29 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463" returned: 0 in 0.248s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.981s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-quobyte-74edb334-0455-4850-94df-32a197f0134f-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" by "_create_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ab534-b5e7-45df-873f-083468dfe6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09a4bdf-0192-4070-8d62-02e392cf6463', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bba734f-617b-4248-9c22-543ebbe163e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-74edb334-0455-4850-94df-32a197f0134f-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Creating volume 29ae5b4b-6c9f-4225-a1c5-95d04a061a1f from snapshot 74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-quobyte-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" by "_copy_volume_from_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:29 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Volume volume-f09a4bdf-0192-4070-8d62-02e392cf6463 (f09a4bdf-0192-4070-8d62-02e392cf6463): created successfully Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bba734f-617b-4248-9c22-543ebbe163e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Flow 'volume_create_manager' (c115994e-be36-48cd-ac8b-b18df16f7aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-eb915539-ecbf-4459-8526-ed89399e8ea9-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] snapshot: 74edb334-0455-4850-94df-32a197f0134f, volume: 29ae5b4b-6c9f-4225-a1c5-95d04a061a1f, {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Lock "cinder-eb915539-ecbf-4459-8526-ed89399e8ea9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:29 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6d185d0c-af73-4fc0-abc2-427e29768d19 tempest-ProjectReaderTests-682776846 None] Created volume successfully. Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c37dfd-8cc7-466b-ba7e-5b358f986a4d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-eb915539-ecbf-4459-8526-ed89399e8ea9" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-eb915539-ecbf-4459-8526-ed89399e8ea9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot eb915539-ecbf-4459-8526-ed89399e8ea9 of volume 8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[71259c58-8a6d-4425-84db-65f379ce4fe0]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:29 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f Jul 31 11:12:29 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:29 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 Jul 31 11:12:29 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:29 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f" returned: 0 in 0.497s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Creating direct copy from snapshot {{(pid=88837) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 31 11:12:29 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f2d5df-ae0c-49fd-a5e3-acb92edc0278]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9" returned: 0 in 0.468s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b66666-4135-4f6c-96f9-a5413122f18b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:29 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:29 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:29 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Acquiring lock "cinder-f09a4bdf-0192-4070-8d62-02e392cf6463-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:30 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 Jul 31 11:12:30 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Lock "cinder-f09a4bdf-0192-4070-8d62-02e392cf6463-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Acquiring lock "cinder-quobyte-f09a4bdf-0192-4070-8d62-02e392cf6463" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Lock "cinder-quobyte-f09a4bdf-0192-4070-8d62-02e392cf6463" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[35769060-fc72-489d-aa65-db49fb68b63f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:30 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.508s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG cinder.utils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Path /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f not found in is_blk_device check {{(pid=88837) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:30 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 Jul 31 11:12:30 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:30 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f Jul 31 11:12:30 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:30 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" returned: 0 in 0.486s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:30 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 Jul 31 11:12:30 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:30 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463" returned: 0 in 0.515s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:30 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463 Jul 31 11:12:30 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:30 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9" returned: 0 in 0.370s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:30 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:30 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9 Jul 31 11:12:30 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:31 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f09a4bdf-0192-4070-8d62-02e392cf6463" returned: 0 in 0.331s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Lock "cinder-quobyte-f09a4bdf-0192-4070-8d62-02e392cf6463" released by "delete_volume" :: held 0.936s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:31 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707.eb915539-ecbf-4459-8526-ed89399e8ea9" returned: 0 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-eb915539-ecbf-4459-8526-ed89399e8ea9" released by "_delete_snapshot" :: held 1.870s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" released by "delete_snapshot" :: held 1.922s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Created reservations ['b583d9c0-fc93-4a44-97e4-ac0396810957', '1e200d57-2976-4de2-9248-73f3aec9e911', 'beacda55-a251-45b0-8713-c0d864fb8da1', 'caf9fb7b-6ce7-47f3-9933-44d41ba4a2d7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Created reservations ['d39c26b0-15c6-4251-aabf-921e6bb4b3ad', 'e48e50e1-ce32-4a17-a2d7-006fbc633b9f', '6dcabbf4-2f8d-4c9a-bba0-8b343e5fb80d', '5f1c210b-bda3-4b1a-89e4-f367b25dd48d'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:31 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:31 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:31 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-30149a31-693f-4406-9ae5-1bd45b41a0a8 tempest-ProjectMemberTests-164003752 None] Lock "cinder-eb915539-ecbf-4459-8526-ed89399e8ea9-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:31 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.413s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:31 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Deleted volume successfully. Jul 31 11:12:31 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-7d40d080-8ff6-443d-8885-53ba588362b9 tempest-ProjectReaderTests-682776846 None] Lock "cinder-f09a4bdf-0192-4070-8d62-02e392cf6463-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-8d545b6c-12e8-41d3-bb16-2a00ddcc3707-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Lock "cinder-8d545b6c-12e8-41d3-bb16-2a00ddcc3707-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:33 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" acquired by "delete_volume" :: waited 0.051s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:33 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[053bbf83-f36f-4040-a065-2a96fe0ee592]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:33 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:34 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 Jul 31 11:12:34 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Flow 'volume_create_manager' (bdf22bea-e831-47f2-8606-55604769ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcebc49-ad29-497a-a2e1-639e40b8e370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcebc49-ad29-497a-a2e1-639e40b8e370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382066648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab04758-03c9-4021-afa3-781ccc47f7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f0950dcd204144bb857396f25a5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:34Z,use_quota=True,user_id='4659fdf60f0b4f598b8f2ac75e1c919c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4363f634-88de-45c0-bd0c-29353ff8389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4363f634-88de-45c0-bd0c-29353ff8389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12451ab0-7dda-4a0a-a2c6-780839442252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12451ab0-7dda-4a0a-a2c6-780839442252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab04758-03c9-4021-afa3-781ccc47f7b0', 'volume_name': 'volume-eab04758-03c9-4021-afa3-781ccc47f7b0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecce66c2-2844-4b05-9ee8-5419b6554963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecce66c2-2844-4b05-9ee8-5419b6554963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d96344-211b-47a9-9961-57ebba5f6f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:34 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Volume eab04758-03c9-4021-afa3-781ccc47f7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab04758-03c9-4021-afa3-781ccc47f7b0', 'volume_size': 1} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:34 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" returned: 0 in 0.832s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:34 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:34 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707 Jul 31 11:12:34 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:35 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" returned: 0 in 0.499s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8d545b6c-12e8-41d3-bb16-2a00ddcc3707" released by "delete_volume" :: held 1.508s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Created reservations ['3ec43196-a708-4963-830c-f960aa8791c4', 'a4b60789-db44-4cc8-ad65-b60e3000001e', '217350df-3d92-4c2f-81db-bdc6521e4a95', 'd62374e1-5f8d-45f7-8554-757ae471d766'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:35 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:35 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:35 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" returned: 0 in 5.431s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f543ad-69b8-4ddc-9bf0-7c9e88f459f7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:35 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:35 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:35 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:35 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:35 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4ee25fb2-703f-429c-8e0a-efee376d3be2 tempest-ProjectMemberTests-164003752 None] Lock "cinder-8d545b6c-12e8-41d3-bb16-2a00ddcc3707-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:36 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.673s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.image.image_utils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Image conversion details: src /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f {{(pid=88837) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 31 11:12:36 devstack cinder-volume[88837]: INFO cinder.image.image_utils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Converted 1024.00 MB image at 188.50 MB/s Jul 31 11:12:36 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f is being set with open permissions: ugo+rw Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:36 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f Jul 31 11:12:36 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (3bbd6fc6-2af7-47f8-8c62-fd03dac0194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fefd52-6ef9-414c-8914-157c44df382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fefd52-6ef9-414c-8914-157c44df382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053396619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f071d8e3-15e7-42a9-aecc-e969e29ce132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:36Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219b8d17-e356-4c18-89d7-d0f0333c2e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219b8d17-e356-4c18-89d7-d0f0333c2e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe2af79-f981-4a1b-b33a-dbb368725688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe2af79-f981-4a1b-b33a-dbb368725688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f071d8e3-15e7-42a9-aecc-e969e29ce132', 'volume_name': 'volume-f071d8e3-15e7-42a9-aecc-e969e29ce132', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e156b00d-5560-41c3-8431-d0289140d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e156b00d-5560-41c3-8431-d0289140d392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3561af5-2a58-47ef-a197-a13782296204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:36 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Volume f071d8e3-15e7-42a9-aecc-e969e29ce132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f071d8e3-15e7-42a9-aecc-e969e29ce132', 'volume_size': 1} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:36 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" returned: 0 in 0.264s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" released by "_copy_volume_from_snapshot" :: held 7.508s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-74edb334-0455-4850-94df-32a197f0134f-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" released by "_create_volume_from_snapshot" :: held 7.558s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.593s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.221s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1382066648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab04758-03c9-4021-afa3-781ccc47f7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f0950dcd204144bb857396f25a5f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:34Z,use_quota=True,user_id='4659fdf60f0b4f598b8f2ac75e1c919c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Creating volume eab04758-03c9-4021-afa3-781ccc47f7b0 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:36 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:36 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 1073741824 Jul 31 11:12:36 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097a28c6-5a70-498a-bfef-2428dd63abdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f', 'volume_size': 1, 'snapshot_id': '74edb334-0455-4850-94df-32a197f0134f'}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6632d06c-5ea1-4b2e-a816-a8ad14afd3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:36 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Volume volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f (29ae5b4b-6c9f-4225-a1c5-95d04a061a1f): created successfully Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6632d06c-5ea1-4b2e-a816-a8ad14afd3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:36 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Flow 'volume_create_manager' (6f616479-bc82-4237-bd40-e3ccf180307d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:36 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4848dc78-3af8-4046-90aa-7052a51417a4 tempest-SnapshotDependencyTests-1688397891 None] Created volume successfully. Jul 31 11:12:37 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 1073741824" returned: 0 in 0.523s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:37 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 Jul 31 11:12:37 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:37 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2053396619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f071d8e3-15e7-42a9-aecc-e969e29ce132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:36Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Creating volume f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:37 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:37 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 1073741824 Jul 31 11:12:37 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d96344-211b-47a9-9961-57ebba5f6f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab04758-03c9-4021-afa3-781ccc47f7b0', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1db5127-d8be-4b2e-a589-c846b5946830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:37 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Volume volume-eab04758-03c9-4021-afa3-781ccc47f7b0 (eab04758-03c9-4021-afa3-781ccc47f7b0): created successfully Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1db5127-d8be-4b2e-a589-c846b5946830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:37 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Flow 'volume_create_manager' (bdf22bea-e831-47f2-8606-55604769ad48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:37 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-9ccb3798-158e-4306-b332-4dccc8611af0 tempest-ProjectReaderTests-682776846 None] Created volume successfully. Jul 31 11:12:38 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 1073741824" returned: 0 in 0.422s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:38 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 Jul 31 11:12:38 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-74edb334-0455-4850-94df-32a197f0134f-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-74edb334-0455-4850-94df-32a197f0134f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-quobyte-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-quobyte-74edb334-0455-4850-94df-32a197f0134f" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Acquiring lock "cinder-eab04758-03c9-4021-afa3-781ccc47f7b0-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-74edb334-0455-4850-94df-32a197f0134f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Deleting offline snapshot 74edb334-0455-4850-94df-32a197f0134f of volume 8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] snapshot_file for this snap is: volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Lock "cinder-eab04758-03c9-4021-afa3-781ccc47f7b0-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6483a2fc-7ea7-4fea-8ecd-6435b9f01f6f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Acquiring lock "cinder-quobyte-eab04758-03c9-4021-afa3-781ccc47f7b0" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Lock "cinder-quobyte-eab04758-03c9-4021-afa3-781ccc47f7b0" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76750a4-d4af-4129-9c4c-357d18f3aede]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:38 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132" returned: 0 in 0.291s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:38 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f Jul 31 11:12:38 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3561af5-2a58-47ef-a197-a13782296204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f071d8e3-15e7-42a9-aecc-e969e29ce132', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f061b63a-b61a-440c-afb2-2b5cce015447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:38 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Volume volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 (f071d8e3-15e7-42a9-aecc-e969e29ce132): created successfully Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f061b63a-b61a-440c-afb2-2b5cce015447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (3bbd6fc6-2af7-47f8-8c62-fd03dac0194c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:38 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4d6099be-70c4-4058-af0d-c09efd33d5b2 tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:12:38 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 Jul 31 11:12:38 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:38 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f" returned: 0 in 0.389s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a7f1c5-1097-42d7-b2a5-553e76dee44d]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:38 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0" returned: 0 in 0.402s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:38 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0 Jul 31 11:12:38 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 06ae7fc3-48a8-4db4-ab69-11a80aef85a3 of volume f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:38 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:38 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[597857bf-8b55-4c65-9470-04a271b58024]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:38 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 Jul 31 11:12:38 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:38 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-eab04758-03c9-4021-afa3-781ccc47f7b0" returned: 0 in 0.248s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:38 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Lock "cinder-quobyte-eab04758-03c9-4021-afa3-781ccc47f7b0" released by "delete_volume" :: held 0.697s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Created reservations ['705f1c18-4511-4894-9753-919543a675f0', 'ec69e33b-7bda-40ba-9d3b-f21ba70d851b', '294965c4-7a97-47b0-9c4f-355328b90e20', 'ba82b80a-5318-4825-b016-3a95965b8983'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:39 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.421s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:39 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f Jul 31 11:12:39 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:39 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:39 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:39 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132" returned: 0 in 0.403s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:39 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 1G Jul 31 11:12:39 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:39 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.301s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Deleted volume successfully. Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-e37f8224-9a71-4fd6-b9c2-0940992be52a tempest-ProjectReaderTests-682776846 None] Lock "cinder-eab04758-03c9-4021-afa3-781ccc47f7b0-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:39 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f" returned: 0 in 0.403s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:39 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f Jul 31 11:12:39 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:39 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 1G" returned: 0 in 0.493s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:39 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 Jul 31 11:12:39 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:39 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9.74edb334-0455-4850-94df-32a197f0134f" returned: 0 in 0.286s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-74edb334-0455-4850-94df-32a197f0134f" released by "_delete_snapshot" :: held 1.662s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" released by "delete_snapshot" :: held 1.692s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Created reservations ['44733776-58c5-425e-ba08-0ed68de8e304', 'c76a2be1-5bf1-4a72-8e3c-8e1536184ccd', '1b1468e3-9616-4ce7-8227-0ed7fbf79227', '1373154a-33bb-4301-9d9e-cac939a2e8c2'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:39 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Delete snapshot completed successfully. Jul 31 11:12:39 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bec6dc94-33c0-4975-a29e-35d7838d918f tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-74edb334-0455-4850-94df-32a197f0134f-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:40 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3" returned: 0 in 0.328s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:40 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 is being set with open permissions: ugo+rw Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:40 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 Jul 31 11:12:40 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:40 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3" returned: 0 in 0.275s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-quobyte-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:40 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info Jul 31 11:12:40 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c835156-4e1e-400d-8c6f-ac27f4cbd2a7]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:40 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:40 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:40 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info" returned: 0 in 0.285s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:40 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info is being set with open permissions: ugo+rw Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:40 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info Jul 31 11:12:40 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:40 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.428s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:40 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9 Jul 31 11:12:40 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:40 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:40 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.info" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0d284f71-10db-4dca-a776-64a615ce9a67 tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:12:41 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" returned: 0 in 0.274s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9" released by "delete_volume" :: held 0.774s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Created reservations ['bea8689c-850a-4937-b9e7-9576e5b816c8', 'feaa7182-6323-4603-b15e-3be775a0e7e7', '0da58739-a314-4220-888d-9d7889ec6a9b', 'a56d9f52-023e-4599-bfd6-54250bf559e4'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:41 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:41 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "cinder-quobyte-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" acquired by "delete_volume" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:41 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.298s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:41 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Deleted volume successfully. Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f85b38-ac95-42c0-a12f-d590703d67c4]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4deb2b18-73de-4de7-85e3-a4dacff45841 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-8ea13a3d-1a33-4ab7-bf96-0e47890ecfa9-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:41 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f Jul 31 11:12:41 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:41 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-06ae7fc3-48a8-4db4-ab69-11a80aef85a3-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Lock "cinder-06ae7fc3-48a8-4db4-ab69-11a80aef85a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-f071d8e3-15e7-42a9-aecc-e969e29ce132" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f071d8e3-15e7-42a9-aecc-e969e29ce132" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-06ae7fc3-48a8-4db4-ab69-11a80aef85a3" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-06ae7fc3-48a8-4db4-ab69-11a80aef85a3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 06ae7fc3-48a8-4db4-ab69-11a80aef85a3 of volume f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:42 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" returned: 0 in 0.434s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82dd8b6-8600-4a5e-8e63-65ac7ef83434]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:42 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f Jul 31 11:12:42 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:42 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 Jul 31 11:12:42 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:42 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" returned: 0 in 0.262s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-quobyte-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f" released by "delete_volume" :: held 0.747s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Created reservations ['ee16c64c-56b5-4572-aced-73293df3c5b6', 'b28dac93-242d-40b8-8df9-15f61c41a1a5', 'cb41e010-9829-4008-9d6a-4982da441890', '06bb699b-6a4a-4d36-ae42-e633607b67e6'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:42 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3" returned: 0 in 0.413s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f071d8e3-15e7-42a9-aecc-e969e29ce132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:42 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:42 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a80ac-614f-472b-ba9c-7fe3eafc0e24]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:42 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 Jul 31 11:12:42 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:42 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.307s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:42 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Deleted volume successfully. Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-a33e1be4-4083-4d8a-9081-0a1a73fe3592 tempest-SnapshotDependencyTests-1688397891 None] Lock "cinder-29ae5b4b-6c9f-4225-a1c5-95d04a061a1f-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:42 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132" returned: 0 in 0.417s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:42 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:42 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 Jul 31 11:12:42 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:43 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3" returned: 0 in 0.400s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:43 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3 Jul 31 11:12:43 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:43 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132.06ae7fc3-48a8-4db4-ab69-11a80aef85a3" returned: 0 in 0.294s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-06ae7fc3-48a8-4db4-ab69-11a80aef85a3" released by "_delete_snapshot" :: held 1.670s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f071d8e3-15e7-42a9-aecc-e969e29ce132" released by "delete_snapshot" :: held 1.715s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Created reservations ['294930a6-6601-4d18-95b3-8bcd52bba7c2', '58f84bcb-076e-40d9-bd92-3429145fa9d8', 'ec3be3ae-fee2-492b-9df6-5812717f21bc', '4b43463c-00f9-4b13-a6fb-2328f51e96b7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:43 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:12:43 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-bf274178-8686-4cf4-99bf-f6eb4a4aacd5 tempest-ProjectMemberTests-164003752 None] Lock "cinder-06ae7fc3-48a8-4db4-ab69-11a80aef85a3-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-f071d8e3-15e7-42a9-aecc-e969e29ce132-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Lock "cinder-f071d8e3-15e7-42a9-aecc-e969e29ce132-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-f071d8e3-15e7-42a9-aecc-e969e29ce132" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f071d8e3-15e7-42a9-aecc-e969e29ce132" acquired by "delete_volume" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a8be3-2391-445a-9d48-74d2e578f9ce]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:44 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 Jul 31 11:12:44 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:44 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132" returned: 0 in 0.431s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:44 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:44 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132 Jul 31 11:12:44 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:45 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f071d8e3-15e7-42a9-aecc-e969e29ce132" returned: 0 in 0.266s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f071d8e3-15e7-42a9-aecc-e969e29ce132" released by "delete_volume" :: held 0.780s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Created reservations ['65b649ee-53b2-4e38-bdb7-4af50cb4f032', '83e98363-72e1-499d-af22-2cdec13d32fe', '9ba7cc36-0d26-41a0-b01a-e49c6e0d8b79', '93192836-a30f-4a16-a0ae-28b2f891cabe'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:45 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:45 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:45 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.332s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:45 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-68b4984a-43b9-4073-a037-dbf1855707af tempest-ProjectMemberTests-164003752 None] Lock "cinder-f071d8e3-15e7-42a9-aecc-e969e29ce132-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (7102f6e2-28a5-4204-b5f3-098602c0dbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:45 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2e3bbf-777b-46ea-949a-0331af769bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2e3bbf-777b-46ea-949a-0331af769bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201767462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461d9529-c6e3-4d53-9512-4ddb2157a8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:46Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad0b91b-20f7-4ccf-aec3-d472e9b76204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad0b91b-20f7-4ccf-aec3-d472e9b76204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efbc7b0-c3cc-49a8-9b50-3c4e7597b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efbc7b0-c3cc-49a8-9b50-3c4e7597b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461d9529-c6e3-4d53-9512-4ddb2157a8f6', 'volume_name': 'volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf19527c-afe0-4364-ad22-2adeff042858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf19527c-afe0-4364-ad22-2adeff042858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2494b09f-01e4-480d-8e6d-63118b34725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:46 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Volume 461d9529-c6e3-4d53-9512-4ddb2157a8f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6', 'volume_size': 1} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201767462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461d9529-c6e3-4d53-9512-4ddb2157a8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:46Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Creating volume 461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:46 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:46 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 1073741824 Jul 31 11:12:46 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:46 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:46 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:46 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 1073741824" returned: 0 in 0.630s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:46 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 Jul 31 11:12:46 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:47 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.429s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 31 11:12:47 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6" returned: 0 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2494b09f-01e4-480d-8e6d-63118b34725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c4ecc7-a950-4d74-9285-44a686365a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:47 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Volume volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 (461d9529-c6e3-4d53-9512-4ddb2157a8f6): created successfully Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c4ecc7-a950-4d74-9285-44a686365a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:47 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (7102f6e2-28a5-4204-b5f3-098602c0dbf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:47 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-f5309797-3f5e-47de-b0bd-b4a693d8d71e tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 8f5b492c-1297-4b43-b3c5-9766b2cff0d7 of volume 461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[510e2eaf-3245-47d2-8905-f95f023debde]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:48 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 Jul 31 11:12:48 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:48 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6" returned: 0 in 0.431s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:48 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:48 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 1G Jul 31 11:12:48 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:49 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 1G" returned: 0 in 0.507s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:49 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 Jul 31 11:12:49 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:49 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7" returned: 0 in 0.347s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:49 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 is being set with open permissions: ugo+rw Jul 31 11:12:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:49 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 Jul 31 11:12:49 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:49 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:49 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:50 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info Jul 31 11:12:50 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:50 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info" returned: 0 in 0.278s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:50 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info is being set with open permissions: ugo+rw Jul 31 11:12:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:50 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info Jul 31 11:12:50 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:50 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.info" returned: 0 in 0.315s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:50 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:50 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-dc281f50-2765-40d4-bc29-d4236b1914fb tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-8f5b492c-1297-4b43-b3c5-9766b2cff0d7-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Lock "cinder-8f5b492c-1297-4b43-b3c5-9766b2cff0d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-461d9529-c6e3-4d53-9512-4ddb2157a8f6" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-461d9529-c6e3-4d53-9512-4ddb2157a8f6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-8f5b492c-1297-4b43-b3c5-9766b2cff0d7" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8f5b492c-1297-4b43-b3c5-9766b2cff0d7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 8f5b492c-1297-4b43-b3c5-9766b2cff0d7 of volume 461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c039c36-20d6-4708-bded-fcf94908f7b1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:51 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:51 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 Jul 31 11:12:51 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:52 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7" returned: 0 in 0.421s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fe8e21-a7bc-42a2-b00a-fb5921d12a41]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:52 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 Jul 31 11:12:52 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:52 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6" returned: 0 in 0.433s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:52 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 Jul 31 11:12:52 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:52 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7" returned: 0 in 0.419s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:52 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:52 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7 Jul 31 11:12:52 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:53 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6.8f5b492c-1297-4b43-b3c5-9766b2cff0d7" returned: 0 in 0.285s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8f5b492c-1297-4b43-b3c5-9766b2cff0d7" released by "_delete_snapshot" :: held 1.663s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-461d9529-c6e3-4d53-9512-4ddb2157a8f6" released by "delete_snapshot" :: held 1.694s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Created reservations ['0b3490e8-5fba-4534-b5f3-c2bfe798f7b6', 'dd174e69-9ee2-4919-80c5-6d72f8a445e8', '79178627-8f8e-4ccb-a4ad-f8a0ea3a5763', '72711b0a-8e4b-474d-8a6a-1a659873d089'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:53 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-8d3ac240-c179-4694-a2e6-317d62e19948 tempest-ProjectMemberTests-164003752 None] Lock "cinder-8f5b492c-1297-4b43-b3c5-9766b2cff0d7-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-461d9529-c6e3-4d53-9512-4ddb2157a8f6-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Lock "cinder-461d9529-c6e3-4d53-9512-4ddb2157a8f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-461d9529-c6e3-4d53-9512-4ddb2157a8f6" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-461d9529-c6e3-4d53-9512-4ddb2157a8f6" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208c45e-8f80-40d2-b0a9-ead97ff04b9f]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:53 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:53 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 Jul 31 11:12:53 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (7ff263b2-3d93-4171-a4ad-fbab4148d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f240aac-f7e1-4140-86cc-2b1916bf1f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f240aac-f7e1-4140-86cc-2b1916bf1f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434499645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e521a0ba-d800-45f9-b021-a12f8183095b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:54Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f44a3ea-2db3-44fa-9e5b-10f6987e862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f44a3ea-2db3-44fa-9e5b-10f6987e862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abd6aa8-8022-4105-8a15-b66282349134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abd6aa8-8022-4105-8a15-b66282349134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e521a0ba-d800-45f9-b021-a12f8183095b', 'volume_name': 'volume-e521a0ba-d800-45f9-b021-a12f8183095b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a05eb4-6b39-4c6d-b847-70ece78037ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a05eb4-6b39-4c6d-b847-70ece78037ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:54 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc27b6a-4d68-492c-95be-1d10422a0954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:54 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Volume e521a0ba-d800-45f9-b021-a12f8183095b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e521a0ba-d800-45f9-b021-a12f8183095b', 'volume_size': 1} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434499645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e521a0ba-d800-45f9-b021-a12f8183095b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:54Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Creating volume e521a0ba-d800-45f9-b021-a12f8183095b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:54 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6" returned: 0 in 0.427s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:54 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b 1073741824 Jul 31 11:12:54 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:54 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6 Jul 31 11:12:54 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:54 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-461d9529-c6e3-4d53-9512-4ddb2157a8f6" returned: 0 in 0.265s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-461d9529-c6e3-4d53-9512-4ddb2157a8f6" released by "delete_volume" :: held 0.750s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Created reservations ['a04e4b7b-8857-4624-918e-ec399338a1a2', 'ea38c0f1-6336-415e-9492-a052f7d4cf06', 'd89db9de-6688-4990-a8d6-196997ae11d9', '66b8db06-2f97-491b-9003-ed59ce50a272'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:54 devstack sudo[109566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:54 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:54 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b 1073741824" returned: 0 in 0.491s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:54 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b Jul 31 11:12:54 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:54 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.294s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:54 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:54 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-606965c0-f8d4-43f4-b323-3f3c9ae53d15 tempest-ProjectMemberTests-164003752 None] Lock "cinder-461d9529-c6e3-4d53-9512-4ddb2157a8f6-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:55 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b" returned: 0 in 0.310s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc27b6a-4d68-492c-95be-1d10422a0954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e521a0ba-d800-45f9-b021-a12f8183095b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef99c976-2505-43c8-8368-72669e7713ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Volume volume-e521a0ba-d800-45f9-b021-a12f8183095b (e521a0ba-d800-45f9-b021-a12f8183095b): created successfully Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef99c976-2505-43c8-8368-72669e7713ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (7ff263b2-3d93-4171-a4ad-fbab4148d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:55 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a5ef7b3d-daed-4970-9d7f-f8bc3f48af69 tempest-ProjectReaderTests-1912696525 None] Created volume successfully. Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (8ba7c7d3-b475-460e-b15c-5c7590edefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac3bba1-be79-4a04-8016-ea4982be1738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac3bba1-be79-4a04-8016-ea4982be1738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1432401940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f285bfb1-212d-4567-8d8e-637e53644da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:55Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72565f56-b4e0-4cb9-9400-6af826e16746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72565f56-b4e0-4cb9-9400-6af826e16746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e026ec63-3cf2-486d-86f0-857b0798c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e026ec63-3cf2-486d-86f0-857b0798c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f285bfb1-212d-4567-8d8e-637e53644da3', 'volume_name': 'volume-f285bfb1-212d-4567-8d8e-637e53644da3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f57de38-154b-41b4-9a16-ca62fef73d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f57de38-154b-41b4-9a16-ca62fef73d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7421ddb-e0a9-4482-8dd0-b2857ed434d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:55 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Volume f285bfb1-212d-4567-8d8e-637e53644da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f285bfb1-212d-4567-8d8e-637e53644da3', 'volume_size': 1} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1432401940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f285bfb1-212d-4567-8d8e-637e53644da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:55Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Creating volume f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:55 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:55 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 1073741824 Jul 31 11:12:55 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:55 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 1073741824" returned: 0 in 0.444s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:55 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:55 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 Jul 31 11:12:55 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:56 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3" returned: 0 in 0.242s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7421ddb-e0a9-4482-8dd0-b2857ed434d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f285bfb1-212d-4567-8d8e-637e53644da3', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b3169e-44d0-493b-b5f6-72e1e558b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:56 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Volume volume-f285bfb1-212d-4567-8d8e-637e53644da3 (f285bfb1-212d-4567-8d8e-637e53644da3): created successfully Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b3169e-44d0-493b-b5f6-72e1e558b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (8ba7c7d3-b475-460e-b15c-5c7590edefb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:56 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d92dc252-9613-4149-8d15-89d4e843788b tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-e521a0ba-d800-45f9-b021-a12f8183095b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Lock "cinder-e521a0ba-d800-45f9-b021-a12f8183095b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-quobyte-e521a0ba-d800-45f9-b021-a12f8183095b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-e521a0ba-d800-45f9-b021-a12f8183095b" acquired by "delete_volume" :: waited 0.023s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c9a20-834c-46c3-93a7-c69d704a4072]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 2950be85-1787-4e8b-948b-05c46f8133a0 of volume f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[b697fbdb-e066-4f5e-ad41-28891728c8fd]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:56 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:56 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b Jul 31 11:12:56 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:56 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 Jul 31 11:12:56 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:57 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b" returned: 0 in 0.386s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:57 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b Jul 31 11:12:57 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:57 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3" returned: 0 in 0.399s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:57 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 1G Jul 31 11:12:57 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:57 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-e521a0ba-d800-45f9-b021-a12f8183095b" returned: 0 in 0.286s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-e521a0ba-d800-45f9-b021-a12f8183095b" released by "delete_volume" :: held 0.772s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Created reservations ['b647bb3b-6b6f-422a-ad40-776a6dd785ff', '1e316a80-d33e-4a68-b0d6-0b1ddad704e1', '113ceecb-b489-49c6-9045-b4230c9c0482', '271b5dc5-2acf-475e-80be-ba77e9ea2863'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:57 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:12:57 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:57 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 1G" returned: 0 in 0.442s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f285bfb1-212d-4567-8d8e-637e53644da3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:57 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f285bfb1-212d-4567-8d8e-637e53644da3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 Jul 31 11:12:57 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:57 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.280s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:12:57 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Deleted volume successfully. Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-5f14b1d6-a429-4813-a00f-4a481d6944ea tempest-ProjectReaderTests-1912696525 None] Lock "cinder-e521a0ba-d800-45f9-b021-a12f8183095b-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:12:57 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f285bfb1-212d-4567-8d8e-637e53644da3 -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0" returned: 0 in 0.363s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:57 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 is being set with open permissions: ugo+rw Jul 31 11:12:57 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:57 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 Jul 31 11:12:57 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (817718e3-fe1b-4de2-a40a-d99e3b6be3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ed08ff-856c-40d4-b709-11392e4dfe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ed08ff-856c-40d4-b709-11392e4dfe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1194260067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f7b01b-211b-4871-a60d-ca327ff62376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:58Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99349792-ae58-483e-b9e7-19efc5f96546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99349792-ae58-483e-b9e7-19efc5f96546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:58 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd81434-25c1-45fc-959a-da488b7ebd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd81434-25c1-45fc-959a-da488b7ebd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f7b01b-211b-4871-a60d-ca327ff62376', 'volume_name': 'volume-22f7b01b-211b-4871-a60d-ca327ff62376', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961b5348-b80a-4d08-a802-8c6d236da4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961b5348-b80a-4d08-a802-8c6d236da4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5bbea5-5910-4736-b403-0b219812a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:58 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Volume 22f7b01b-211b-4871-a60d-ca327ff62376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f7b01b-211b-4871-a60d-ca327ff62376', 'volume_size': 1} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0" returned: 0 in 0.304s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:58 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info Jul 31 11:12:58 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:58 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info" returned: 0 in 0.247s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:58 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info is being set with open permissions: ugo+rw Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:58 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info Jul 31 11:12:58 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:58 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.info" returned: 0 in 0.255s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1194260067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f7b01b-211b-4871-a60d-ca327ff62376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:12:58Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Creating volume 22f7b01b-211b-4871-a60d-ca327ff62376 {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:12:58 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:12:58 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:58 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 1073741824 Jul 31 11:12:58 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:58 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-0141339a-18ec-41d7-983c-02ebdbdc2410 tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:12:59 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 1073741824" returned: 0 in 0.452s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=194,cinder:DELETE=19,cinder:INSERT=50,cinder:SELECT=154 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=207,cinder:SELECT=165,cinder:INSERT=63,cinder:DELETE=16 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:59 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 Jul 31 11:12:59 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:12:59 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376" returned: 0 in 0.260s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5bbea5-5910-4736-b403-0b219812a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f7b01b-211b-4871-a60d-ca327ff62376', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fa2bad-acab-4899-9112-2f28f4252930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:12:59 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Volume volume-22f7b01b-211b-4871-a60d-ca327ff62376 (22f7b01b-211b-4871-a60d-ca327ff62376): created successfully Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0fa2bad-acab-4899-9112-2f28f4252930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (817718e3-fe1b-4de2-a40a-d99e3b6be3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:12:59 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c1f958da-b820-4904-a7e0-989b853c63c5 tempest-ProjectReaderTests-1912696525 None] Created volume successfully. Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-2950be85-1787-4e8b-948b-05c46f8133a0-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Lock "cinder-2950be85-1787-4e8b-948b-05c46f8133a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-f285bfb1-212d-4567-8d8e-637e53644da3" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f285bfb1-212d-4567-8d8e-637e53644da3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-2950be85-1787-4e8b-948b-05c46f8133a0" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-2950be85-1787-4e8b-948b-05c46f8133a0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 2950be85-1787-4e8b-948b-05c46f8133a0 of volume f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9dc532-eaaf-4f12-be20-edf3b0ceed27]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:12:59 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:12:59 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 Jul 31 11:12:59 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:00 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0" returned: 0 in 0.376s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f285bfb1-212d-4567-8d8e-637e53644da3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8b2fd6-295c-4f38-b74b-85efecbba0a3]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-22f7b01b-211b-4871-a60d-ca327ff62376-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Lock "cinder-22f7b01b-211b-4871-a60d-ca327ff62376-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-quobyte-22f7b01b-211b-4871-a60d-ca327ff62376" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:00 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 Jul 31 11:13:00 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-22f7b01b-211b-4871-a60d-ca327ff62376" acquired by "delete_volume" :: waited 0.021s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b4e28f-154a-45bc-ab6b-50ce78c227c1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:00 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 Jul 31 11:13:00 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:00 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3" returned: 0 in 0.415s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:00 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 Jul 31 11:13:00 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:00 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376" returned: 0 in 0.378s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:00 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:00 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376 Jul 31 11:13:00 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:01 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0" returned: 0 in 0.396s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:01 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0 Jul 31 11:13:01 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:01 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-22f7b01b-211b-4871-a60d-ca327ff62376" returned: 0 in 0.346s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-22f7b01b-211b-4871-a60d-ca327ff62376" released by "delete_volume" :: held 0.766s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Created reservations ['f45aacf0-7ec8-40f8-9175-0c57b0be69a2', 'f9dca348-19bd-4b3b-bac1-8496c40d215d', 'caf73d8d-bc32-4b4d-bacb-211d6330d802', 'db67edea-4f91-4ab8-ad1a-96c0dfd67a13'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:01 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:01 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:01 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3.2950be85-1787-4e8b-948b-05c46f8133a0" returned: 0 in 0.299s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-2950be85-1787-4e8b-948b-05c46f8133a0" released by "_delete_snapshot" :: held 1.600s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f285bfb1-212d-4567-8d8e-637e53644da3" released by "delete_snapshot" :: held 1.628s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Created reservations ['62118e5e-f5ad-4464-a7f8-6638e8d8fec6', 'afe6dd45-6bce-4032-8968-1f1011ab6a36', 'd064b476-c0a1-4b14-94a8-6fc536d0ee21', '3ac82761-4cd2-4ece-b231-5d59a13c999e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b3b9ee19-dc53-48c7-8c15-e307f7cfd0da tempest-ProjectMemberTests-164003752 None] Lock "cinder-2950be85-1787-4e8b-948b-05c46f8133a0-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:01 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.341s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:01 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Deleted volume successfully. Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-4cd03fe0-ab65-4370-bbdd-fb003afca10b tempest-ProjectReaderTests-1912696525 None] Lock "cinder-22f7b01b-211b-4871-a60d-ca327ff62376-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-f285bfb1-212d-4567-8d8e-637e53644da3-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Lock "cinder-f285bfb1-212d-4567-8d8e-637e53644da3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:01 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-f285bfb1-212d-4567-8d8e-637e53644da3" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f285bfb1-212d-4567-8d8e-637e53644da3" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e259d4ce-bd45-4204-8aa2-5e1f2e02f776]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (53620483-5e28-4425-a058-f075cd9f524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5d1bbd-e998-4071-8f45-c0d54d81a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5d1bbd-e998-4071-8f45-c0d54d81a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224225776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c700c19-2e2f-43c0-a1d3-29b033ef0efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:02Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f3de9f-f7c4-49fb-85ba-3e6caea6a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f3de9f-f7c4-49fb-85ba-3e6caea6a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cebd537-1987-43b3-ae64-499d5f28f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cebd537-1987-43b3-ae64-499d5f28f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c700c19-2e2f-43c0-a1d3-29b033ef0efa', 'volume_name': 'volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0ea994-528b-4294-89dd-08019ebff5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0ea994-528b-4294-89dd-08019ebff5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996fc7bf-d559-4efa-8227-417fd11751f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:02 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Volume 7c700c19-2e2f-43c0-a1d3-29b033ef0efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa', 'volume_size': 1} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224225776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c700c19-2e2f-43c0-a1d3-29b033ef0efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:02Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Creating volume 7c700c19-2e2f-43c0-a1d3-29b033ef0efa {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:02 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:02 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:13:02 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:02 devstack sudo[109658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa 1073741824 Jul 31 11:13:02 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:02 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3" returned: 0 in 0.398s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:02 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3 Jul 31 11:13:02 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:02 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa 1073741824" returned: 0 in 0.451s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:02 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa Jul 31 11:13:02 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:02 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f285bfb1-212d-4567-8d8e-637e53644da3" returned: 0 in 0.279s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-f285bfb1-212d-4567-8d8e-637e53644da3" released by "delete_volume" :: held 0.736s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Created reservations ['965890dc-573c-4deb-b05a-3a722b06823c', '31e6bdb2-196b-4d59-97d4-bdabe506ebc6', '8ad80f7a-b1cd-4116-8f02-39d8f77197c3', 'f6494c0f-8393-4faa-a77d-81647b3e4598'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:02 devstack sudo[109672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:02 devstack sudo[109672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:02 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa" returned: 0 in 0.282s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996fc7bf-d559-4efa-8227-417fd11751f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:02 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33694b4b-8c43-4cfa-9d98-24dea920eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:02 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Volume volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa (7c700c19-2e2f-43c0-a1d3-29b033ef0efa): created successfully Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33694b4b-8c43-4cfa-9d98-24dea920eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (53620483-5e28-4425-a058-f075cd9f524e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-61fb560c-4d6a-4aad-a35f-f05640136b36 tempest-ProjectReaderTests-1912696525 None] Created volume successfully. Jul 31 11:13:03 devstack sudo[109672]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.286s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:03 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-3a229c83-b36f-4408-8085-99be0f8b4221 tempest-ProjectMemberTests-164003752 None] Lock "cinder-f285bfb1-212d-4567-8d8e-637e53644da3-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (a2624b5a-2ea1-42f4-8046-6fd9f160fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e61d6d9-fb1e-4a45-8da6-327b7ed4b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e61d6d9-fb1e-4a45-8da6-327b7ed4b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-20277828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07958445-4d4e-412d-b207-d8f036290d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:04Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b3de1c-fd89-4e29-ab48-c5a02f904f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b3de1c-fd89-4e29-ab48-c5a02f904f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddceb2b2-2cae-41df-9fdc-b734aaedfebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddceb2b2-2cae-41df-9fdc-b734aaedfebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07958445-4d4e-412d-b207-d8f036290d7b', 'volume_name': 'volume-07958445-4d4e-412d-b207-d8f036290d7b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7297c152-9b46-4d99-b9ad-8d49581eacd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7297c152-9b46-4d99-b9ad-8d49581eacd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3da2dc-c276-415a-8253-4737443956df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:03 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Volume 07958445-4d4e-412d-b207-d8f036290d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07958445-4d4e-412d-b207-d8f036290d7b', 'volume_size': 1} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-20277828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07958445-4d4e-412d-b207-d8f036290d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:04Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Creating volume 07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:13:03 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:13:03 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:03 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b 1073741824 Jul 31 11:13:03 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:04 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b 1073741824" returned: 0 in 0.446s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:04 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b Jul 31 11:13:04 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-7c700c19-2e2f-43c0-a1d3-29b033ef0efa-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-7c700c19-2e2f-43c0-a1d3-29b033ef0efa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-quobyte-7c700c19-2e2f-43c0-a1d3-29b033ef0efa" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-7c700c19-2e2f-43c0-a1d3-29b033ef0efa" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e4b1cd-c70b-469f-9416-b47ffba8c9cc]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:04 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa Jul 31 11:13:04 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:04 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b" returned: 0 in 0.255s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3da2dc-c276-415a-8253-4737443956df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07958445-4d4e-412d-b207-d8f036290d7b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cb29ee-e766-4d52-b9b3-189e0bc299f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:04 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Volume volume-07958445-4d4e-412d-b207-d8f036290d7b (07958445-4d4e-412d-b207-d8f036290d7b): created successfully Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2cb29ee-e766-4d52-b9b3-189e0bc299f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (a2624b5a-2ea1-42f4-8046-6fd9f160fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:04 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-379b956e-9040-4596-a484-29daca559c43 tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:13:04 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa" returned: 0 in 0.380s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:04 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa Jul 31 11:13:04 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 of volume 07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[39762a85-2e53-4a2c-9db0-2059561e8069]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:04 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b Jul 31 11:13:04 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:04 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-7c700c19-2e2f-43c0-a1d3-29b033ef0efa" returned: 0 in 0.253s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-7c700c19-2e2f-43c0-a1d3-29b033ef0efa" released by "delete_volume" :: held 0.680s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:04 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Created reservations ['6c1ef5b9-8014-4523-8054-306be8ed2b59', 'a6f412e8-b5ce-4553-976c-d48585ea1921', '64feb805-a8fb-4844-a301-3ba0b2fbafdb', '4cefc7c9-7727-4a79-8c36-d5d92807483e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:05 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:05 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:05 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b" returned: 0 in 0.376s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:05 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 1G Jul 31 11:13:05 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:05 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.302s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:05 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Deleted volume successfully. Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-342b522e-1907-47a0-85f8-a34af8a576a5 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-7c700c19-2e2f-43c0-a1d3-29b033ef0efa-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:05 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 1G" returned: 0 in 0.423s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07958445-4d4e-412d-b207-d8f036290d7b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:05 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07958445-4d4e-412d-b207-d8f036290d7b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 Jul 31 11:13:05 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (ed5118b9-9dd9-4d6c-9005-bddacf8330f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f8fd4e-5784-47c3-8b65-74c18548d975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:05 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f8fd4e-5784-47c3-8b65-74c18548d975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215340697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f014d1b1-1655-4a5b-85a8-e38f6d70243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:06Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f54a605-5a75-42ee-b584-680db1392307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f54a605-5a75-42ee-b584-680db1392307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb4cee0-c04c-4c58-aca9-8302ce328952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb4cee0-c04c-4c58-aca9-8302ce328952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f014d1b1-1655-4a5b-85a8-e38f6d70243b', 'volume_name': 'volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b492898-9f12-4c70-ba84-cc3d7005569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b492898-9f12-4c70-ba84-cc3d7005569b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06036148-ebc6-4b3f-839c-c1e3c0a1c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:05 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Volume f014d1b1-1655-4a5b-85a8-e38f6d70243b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b', 'volume_size': 1} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07958445-4d4e-412d-b207-d8f036290d7b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" returned: 0 in 0.360s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:05 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 is being set with open permissions: ugo+rw Jul 31 11:13:05 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:05 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 Jul 31 11:13:05 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:06 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" returned: 0 in 0.249s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:06 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info Jul 31 11:13:06 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:06 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info" returned: 0 in 0.253s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:06 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info is being set with open permissions: ugo+rw Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:06 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info Jul 31 11:13:06 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:06 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.info" returned: 0 in 0.279s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215340697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f014d1b1-1655-4a5b-85a8-e38f6d70243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f7111d4eb45cabe27ffc5b30271a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:06Z,use_quota=True,user_id='87ffd9dcda774ffd9e59fc228c1533cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Creating volume f014d1b1-1655-4a5b-85a8-e38f6d70243b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:13:06 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:13:06 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:06 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b 1073741824 Jul 31 11:13:06 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:06 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-a8ea0794-0825-4381-aa70-890f7dc2eb3c tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:13:07 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b 1073741824" returned: 0 in 0.407s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:07 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b Jul 31 11:13:07 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:07 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b" returned: 0 in 0.246s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06036148-ebc6-4b3f-839c-c1e3c0a1c426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60184a6c-7c8d-4baf-9dc6-550beb0ef0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:07 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Volume volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b (f014d1b1-1655-4a5b-85a8-e38f6d70243b): created successfully Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60184a6c-7c8d-4baf-9dc6-550beb0ef0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Flow 'volume_create_manager' (ed5118b9-9dd9-4d6c-9005-bddacf8330f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:07 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-eaa25720-dd20-4d82-a5cb-06dc158354f5 tempest-ProjectReaderTests-1912696525 None] Created volume successfully. Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-8a0bd41c-9e4a-4b49-b6f7-53d060f648a9-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Lock "cinder-8a0bd41c-9e4a-4b49-b6f7-53d060f648a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-07958445-4d4e-412d-b207-d8f036290d7b" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-07958445-4d4e-412d-b207-d8f036290d7b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-f014d1b1-1655-4a5b-85a8-e38f6d70243b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:07 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 of volume 07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-f014d1b1-1655-4a5b-85a8-e38f6d70243b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca896b0-0afe-47bb-9168-0da81f6b6525]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "cinder-quobyte-f014d1b1-1655-4a5b-85a8-e38f6d70243b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-f014d1b1-1655-4a5b-85a8-e38f6d70243b" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c780893-96f1-4f52-a2c0-fbc5fafa53f1]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:08 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 Jul 31 11:13:08 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:08 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b Jul 31 11:13:08 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:08 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" returned: 0 in 0.354s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07958445-4d4e-412d-b207-d8f036290d7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5b621c-8446-4740-b2cc-7d39e43924f2]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:08 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b" returned: 0 in 0.367s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:08 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b Jul 31 11:13:08 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:08 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b Jul 31 11:13:08 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:08 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-f014d1b1-1655-4a5b-85a8-e38f6d70243b" returned: 0 in 0.249s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-quobyte-f014d1b1-1655-4a5b-85a8-e38f6d70243b" released by "delete_volume" :: held 0.659s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Created reservations ['0e617d5c-66e1-461a-a6dc-d9f733cf6ad9', '7a5c3790-6b23-49f3-80cb-cf9e3523864d', '456eda4b-8a3d-4ad5-87fd-c900fdbeb499', 'd9df98ab-7692-4568-85f3-504089cc1856'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:08 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b" returned: 0 in 0.397s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:08 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 Jul 31 11:13:08 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:08 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:08 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:08 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:09 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.281s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Deleted volume successfully. Jul 31 11:13:09 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" returned: 0 in 0.370s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-961d59d5-d19f-4043-b7b7-e83c40e9e616 tempest-ProjectReaderTests-1912696525 None] Lock "cinder-f014d1b1-1655-4a5b-85a8-e38f6d70243b-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:09 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9 Jul 31 11:13:09 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:09 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b.8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" returned: 0 in 0.252s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-8a0bd41c-9e4a-4b49-b6f7-53d060f648a9" released by "_delete_snapshot" :: held 1.487s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-07958445-4d4e-412d-b207-d8f036290d7b" released by "delete_snapshot" :: held 1.520s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Created reservations ['65b1135a-cac4-4c84-be7b-b7bc7cd09f07', '6eb11aa8-e7b7-4123-9be7-cb9e67ae6396', '6a8bfeec-1c16-4d02-8a1c-85aa84fd4cf1', '2955c303-3968-432d-8a98-dac3cd4fa7b9'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:09 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:13:09 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-1f8a8fb5-4fa3-424f-af67-02d0eedf8102 tempest-ProjectMemberTests-164003752 None] Lock "cinder-8a0bd41c-9e4a-4b49-b6f7-53d060f648a9-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-07958445-4d4e-412d-b207-d8f036290d7b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Lock "cinder-07958445-4d4e-412d-b207-d8f036290d7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-07958445-4d4e-412d-b207-d8f036290d7b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-07958445-4d4e-412d-b207-d8f036290d7b" acquired by "delete_volume" :: waited 0.017s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1293a7bc-f6cd-4d37-a4f1-4901082b35f9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:10 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b Jul 31 11:13:10 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:10 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b" returned: 0 in 0.399s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:10 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b Jul 31 11:13:10 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:10 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-07958445-4d4e-412d-b207-d8f036290d7b" returned: 0 in 0.245s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-07958445-4d4e-412d-b207-d8f036290d7b" released by "delete_volume" :: held 0.721s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:10 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Created reservations ['d0c70bb5-070a-4173-9e2d-fecec0c2831b', 'a93de089-4832-4219-9fbb-1b8ebc9bced7', 'c4042f84-649f-4092-822c-e44386cd0a4e', '7618d5a4-c6d1-437f-8e07-97825a9806a6'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:11 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:11 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:11 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.243s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:11 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-c7190a17-789a-40f5-b23c-92d2ba2265b9 tempest-ProjectMemberTests-164003752 None] Lock "cinder-07958445-4d4e-412d-b207-d8f036290d7b-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (dfd1ee1e-e19c-4bc2-85d9-8005216c8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d182a63e-d36f-46d3-a618-e03e1d2d9b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d182a63e-d36f-46d3-a618-e03e1d2d9b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693173686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8c2aad-031e-49f3-b7a0-bf74b974f97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:12Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a799e1-337c-4912-8052-32e79e256564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a799e1-337c-4912-8052-32e79e256564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a881b-0809-4eef-9cbf-76b64a408a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a881b-0809-4eef-9cbf-76b64a408a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8c2aad-031e-49f3-b7a0-bf74b974f97b', 'volume_name': 'volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6914c7-9d22-4e78-ba3d-9f6e04fa5906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6914c7-9d22-4e78-ba3d-9f6e04fa5906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f5c9d3-8974-4154-a48a-c1d6df42cdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:11 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Volume ed8c2aad-031e-49f3-b7a0-bf74b974f97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b', 'volume_size': 1} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693173686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8c2aad-031e-49f3-b7a0-bf74b974f97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:12Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Creating volume ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:13:11 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:13:11 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:11 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b 1073741824 Jul 31 11:13:11 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:12 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b 1073741824" returned: 0 in 0.402s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:12 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b Jul 31 11:13:12 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:12 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" returned: 0 in 0.250s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f5c9d3-8974-4154-a48a-c1d6df42cdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf27a6e-64f1-4f49-bef1-f99881737340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:12 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Volume volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b (ed8c2aad-031e-49f3-b7a0-bf74b974f97b): created successfully Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf27a6e-64f1-4f49-bef1-f99881737340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (dfd1ee1e-e19c-4bc2-85d9-8005216c8d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:12 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b8bfff25-fb8c-412f-b407-2a392186229e tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Creating offline snapshot caf756c4-3f62-403b-9396-0cf0d0cde29f of volume ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[0011392f-8a60-4166-b650-7289868f9fc6]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:12 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:13 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b Jul 31 11:13:13 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:13 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" returned: 0 in 0.345s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:13 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f 1G Jul 31 11:13:13 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:13 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f 1G" returned: 0 in 0.380s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:13 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f Jul 31 11:13:13 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:13 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f" returned: 0 in 0.296s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:13 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f is being set with open permissions: ugo+rw Jul 31 11:13:13 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:13 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f Jul 31 11:13:13 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:14 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f" returned: 0 in 0.227s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:14 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info Jul 31 11:13:14 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:14 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info" returned: 0 in 0.236s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:14 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info is being set with open permissions: ugo+rw Jul 31 11:13:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:14 devstack sudo[109844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info Jul 31 11:13:14 devstack sudo[109844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:14 devstack sudo[109844]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.info" returned: 0 in 0.231s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:14 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:14 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-c3d09ddd-a793-496a-b723-03c25c265221 tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-caf756c4-3f62-403b-9396-0cf0d0cde29f-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Lock "cinder-caf756c4-3f62-403b-9396-0cf0d0cde29f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-caf756c4-3f62-403b-9396-0cf0d0cde29f" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-caf756c4-3f62-403b-9396-0cf0d0cde29f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot caf756c4-3f62-403b-9396-0cf0d0cde29f of volume ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32d98f-00e6-47a9-b581-4955c1662c76]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:15 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f Jul 31 11:13:15 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:15 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f" returned: 0 in 0.332s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b1a5b-9a96-4f98-bdd9-66c5ab4659d8]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:15 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b Jul 31 11:13:15 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:15 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" returned: 0 in 0.336s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:15 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:15 devstack sudo[109857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f Jul 31 11:13:15 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:16 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f" returned: 0 in 0.315s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:16 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f Jul 31 11:13:16 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:16 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b.caf756c4-3f62-403b-9396-0cf0d0cde29f" returned: 0 in 0.230s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-caf756c4-3f62-403b-9396-0cf0d0cde29f" released by "_delete_snapshot" :: held 1.299s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" released by "delete_snapshot" :: held 1.317s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Created reservations ['9a41c19e-de61-46f8-a170-80365ab8395f', '1e0c768c-c5d1-449c-bee0-7587b401a638', '46bb5b4f-fcdf-4628-b291-00ae6712f8b6', '46f2deaf-c6bc-419c-bfb9-88f73bdb8d68'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:16 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:13:16 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-6e0c05d5-98f4-4c8e-bf94-f83a1540d36e tempest-ProjectMemberTests-164003752 None] Lock "cinder-caf756c4-3f62-403b-9396-0cf0d0cde29f-delete_snapshot" released by "delete_snapshot" :: held 1.436s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-ed8c2aad-031e-49f3-b7a0-bf74b974f97b-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Lock "cinder-ed8c2aad-031e-49f3-b7a0-bf74b974f97b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" acquired by "delete_volume" :: waited 0.019s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f5a9f-d25e-4d10-8620-d73c443be80b]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:17 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b Jul 31 11:13:17 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:17 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" returned: 0 in 0.337s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:17 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b Jul 31 11:13:17 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:17 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" returned: 0 in 0.236s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-ed8c2aad-031e-49f3-b7a0-bf74b974f97b" released by "delete_volume" :: held 0.629s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Created reservations ['49f178e2-a649-4b4b-b57c-c004d0f75d07', 'fc2f91b2-1fcd-4fae-b5b6-804171dda799', '649f4b98-e399-4b3e-a3d5-ae19b55f9793', '96f7d919-7b57-4cf5-ad4c-779e2901f34e'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:17 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:17 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:17 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:18 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.250s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:18 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-936e287b-5b37-4202-9486-8c770c617bac tempest-ProjectMemberTests-164003752 None] Lock "cinder-ed8c2aad-031e-49f3-b7a0-bf74b974f97b-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.flows.manager.create_volume [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88837) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (e70c6fdb-4b60-49f5-b97e-93449c259e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9e68dd-f6ff-411d-a0ff-dc5a9a647ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9e68dd-f6ff-411d-a0ff-dc5a9a647ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895308666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab0e387-b692-47b4-b6ea-9c2b782fa8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:19Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa630ea8-b297-425c-bee7-41d617cba988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa630ea8-b297-425c-bee7-41d617cba988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e84ad9c-2a8a-440d-9dd4-f256950f7fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e84ad9c-2a8a-440d-9dd4-f256950f7fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab0e387-b692-47b4-b6ea-9c2b782fa8ef', 'volume_name': 'volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d44b29d-664e-4534-a6db-ed6261690dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d44b29d-664e-4534-a6db-ed6261690dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb2a74a-4a22-4c48-a4c4-d7fce18a593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:18 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Volume dab0e387-b692-47b4-b6ea-9c2b782fa8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef', 'volume_size': 1} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-31T09:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895308666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab0e387-b692-47b4-b6ea-9c2b782fa8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='649e21c0271848178467d20049646a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-31T09:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-31T09:13:19Z,use_quota=True,user_id='7a8643a3953a4f989f240101829d255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf13f09f-f623-4568-8ea9-bc338287c104),volume_type_id=bf13f09f-f623-4568-8ea9-bc338287c104)}" {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Creating volume dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Selected osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 as target Quobyte volume. {{(pid=88837) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 31 11:13:18 devstack cinder-volume[88837]: INFO cinder.volume.drivers.remotefs [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] casted to osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3 Jul 31 11:13:18 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef 1073741824 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:18 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef 1073741824 Jul 31 11:13:18 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:19 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef 1073741824" returned: 0 in 0.393s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:19 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef Jul 31 11:13:19 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:19 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" returned: 0 in 0.229s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'} {{(pid=88837) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb2a74a-4a22-4c48-a4c4-d7fce18a593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef', 'volume_size': 1}' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b5b55e-d333-4fdc-98d7-644e9905214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 31 11:13:19 devstack cinder-volume[88837]: INFO cinder.volume.flows.manager.create_volume [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Volume volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef (dab0e387-b692-47b4-b6ea-9c2b782fa8ef): created successfully Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b5b55e-d333-4fdc-98d7-644e9905214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88837) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Flow 'volume_create_manager' (e70c6fdb-4b60-49f5-b97e-93449c259e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88837) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 31 11:13:19 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-197bab08-cac8-4818-9f74-9a14afe53aa2 tempest-ProjectMemberTests-164003752 None] Created volume successfully. Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Creating offline snapshot 88d9d3d8-b85f-4d49-8cb7-418b0506dd9b of volume dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcedc09-00f6-4d09-8f9d-b341c5ea8fc9]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:19 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:20 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef Jul 31 11:13:20 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:20 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" returned: 0 in 0.333s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b 1G {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:20 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b 1G Jul 31 11:13:20 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:20 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b 1G" returned: 0 in 0.375s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:20 devstack sudo[109896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b Jul 31 11:13:20 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:20 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef -F qcow2 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" returned: 0 in 0.277s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:20 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b is being set with open permissions: ugo+rw Jul 31 11:13:20 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:20 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b Jul 31 11:13:20 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:21 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" returned: 0 in 0.249s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:21 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info Jul 31 11:13:21 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:21 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info" returned: 0 in 0.235s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:21 devstack cinder-volume[88837]: WARNING cinder.volume.drivers.remotefs [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info is being set with open permissions: ugo+rw Jul 31 11:13:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:21 devstack sudo[109908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info Jul 31 11:13:21 devstack sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:21 devstack sudo[109908]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.info" returned: 0 in 0.231s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:21 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:21 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-5b10669f-a82c-424d-aa59-1a273d7d187d tempest-ProjectMemberTests-164003752 None] Create snapshot completed successfully Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-88d9d3d8-b85f-4d49-8cb7-418b0506dd9b-delete_snapshot" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Lock "cinder-88d9d3d8-b85f-4d49-8cb7-418b0506dd9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" by "delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" by "_delete_snapshot" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Deleting offline snapshot 88d9d3d8-b85f-4d49-8cb7-418b0506dd9b of volume dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] snapshot_file for this snap is: volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b {{(pid=88837) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0155fa-e6dc-4672-a97b-95dd1e19ba0c]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:22 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b Jul 31 11:13:22 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:22 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" returned: 0 in 0.335s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.remotefs [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88837) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ce274-61b5-4b3d-9798-751ac0801c58]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:22 devstack sudo[109916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef Jul 31 11:13:22 devstack sudo[109916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:22 devstack sudo[109916]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" returned: 0 in 0.337s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:22 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:22 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b Jul 31 11:13:22 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:23 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" returned: 0 in 0.330s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:23 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b Jul 31 11:13:23 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:23 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef.88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" returned: 0 in 0.227s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-88d9d3d8-b85f-4d49-8cb7-418b0506dd9b" released by "_delete_snapshot" :: held 1.314s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" released by "delete_snapshot" :: held 1.338s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Created reservations ['2428aa37-29a5-42c1-b835-bad3d29b4a9a', 'ac3e6aa7-6d9d-473b-91e7-b50865fb59af', 'fd4f4ea7-a5be-4c27-b9d9-65433d96b5cd', '7d851d70-98b9-4da2-9b66-2cd3f86398c7'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:23 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Delete snapshot completed successfully. Jul 31 11:13:23 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-d237e999-d1e2-4764-894e-f9c39e5416c6 tempest-ProjectMemberTests-164003752 None] Lock "cinder-88d9d3d8-b85f-4d49-8cb7-418b0506dd9b-delete_snapshot" released by "delete_snapshot" :: held 1.458s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-dab0e387-b692-47b4-b6ea-9c2b782fa8ef-delete_volume" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Lock "cinder-dab0e387-b692-47b4-b6ea-9c2b782fa8ef-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Acquiring lock "cinder-quobyte-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" by "delete_volume" {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" acquired by "delete_volume" :: waited 0.016s {{(pid=88837) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c017973-76bc-4ec7-8f69-6d7e468eff85]: (4, 'qcow2') {{(pid=90321) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:24 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef Jul 31 11:13:24 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:24 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" returned: 0 in 0.331s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:24 devstack sudo[109934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef Jul 31 11:13:24 devstack sudo[109934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:24 devstack sudo[109934]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119/volume-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" returned: 0 in 0.239s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Lock "cinder-quobyte-dab0e387-b692-47b4-b6ea-9c2b782fa8ef" released by "delete_volume" :: held 0.619s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:24 devstack cinder-volume[88837]: DEBUG cinder.quota [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Created reservations ['f4888008-2fdb-4170-a967-2f3ae1605688', 'ea486602-c797-442c-9f59-6d6158195488', '90546d43-dc64-448f-92b1-1b0d997205fe', '7ee4e6ed-8df9-4032-9db2-f3cd7a171d51'] {{(pid=88837) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:25 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:25 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:25 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.230s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:25 devstack cinder-volume[88837]: INFO cinder.volume.manager [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Deleted volume successfully. Jul 31 11:13:25 devstack cinder-volume[88837]: DEBUG cinder.coordination [None req-b0480f08-2372-4332-b611-3600bdaaf983 tempest-ProjectMemberTests-164003752 None] Lock "cinder-dab0e387-b692-47b4-b6ea-9c2b782fa8ef-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=88837) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 31 11:13:35 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:SELECT=74,cinder:INSERT=28,cinder:UPDATE=95,cinder:DELETE=10 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:13:35 devstack cinder-volume[88837]: DEBUG dbcounter [-] [88837] Writing DB stats cinder:UPDATE=105,cinder:SELECT=69,cinder:INSERT=25,cinder:DELETE=6 {{(pid=88837) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3': None} {{(pid=88837) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa5565ef-c5d5-4a9e-8448-c4b4a407e8b3'] {{(pid=88837) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.lockutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88837) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 31 11:13:46 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119 Jul 31 11:13:46 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 31 11:13:46 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_concurrency.processutils [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6d2c27abf6b33b806f2aca72984e3119" returned: 0 in 0.240s {{(pid=88837) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG cinder.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Notifying Schedulers of capabilities ... {{(pid=88837) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG oslo_service.periodic_task [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] Running periodic task VolumeManager._thread_info {{(pid=88837) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread count: 28 {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 31 11:13:46 devstack cinder-volume[88837]: DEBUG cinder.volume.manager [None req-b6ae8056-87cc-4621-bbc3-8a92a21b8352 None None] thread info: [<_MainThread(MainThread, started 125467748896896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88837) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}